Another issue is that what is socially acceptable has changed. Do you judge a president on doing what is best for the country or doing what is right? Do you factor in hindsight or give them points for their efforts?
17th century has to be Adams but he was a damn great. His competition is Washington himself so it doesn't mean much.
Early 19th century would have to be Madison. The war of 1812 was chaotic and ended with no gains. Jackson killed Indians but literally all presidents did that so its odd how he gets singled out for it. He had a native as one of his sons and he tried to get that son into the military. He was arguably the least racist of the bunch and the first non-aristocratic president. His "trail of tears" wasn't even his legislation, it was VanBurens.
Later 19th century is either Buchanan or Andrew Johnson. I don't think anything could have been done to prevent southern secession so I'll go with Johnson. He crippled efforts to reform the south into something non-shit but also pushed for punitive actions against the south for a good laugh or something.
The Harding administration was famously corrupt (and passed those famous depression-causing tariffs) but Wilson and Taft are probably some of the worst of the early 20th century. Taft toppled the first ever democratically elected government in Mexico and Wilson refused to acknowledge the dictator the USA had installed in his place. Together they caused an immigration crisis on the scale of the Syrian Civil War at America's doorstep and arguably the bloodiest conflict the western hemisphere has ever seen. Wilson's expansion of government power ,crackdown on civil liberties, expansion of white supremacy to the federal level and entry into ww1 were also bad policies. Pretty much every US president did imperialist stuff but McKinley's blatant war of imperialism against the Philippines killed millions for little gain ranks among one of the worst. Hard to choose.
For the later 20th century I'd say that Bush Sr. takes the cake. I like progressive legislation and dislike random wars for no reason. The Bush government deregulated, cut programs and caused chaos through foreign interventions... very suspicious foreign interventions.
https://www.youtube.com/watch?v=LmfVs3WaE9Y
Every president did this sort of stuff though. Eisenhower let a Banana company become a government, Kennedy installed fascist governments throughout central America, etc.
21st century is easy. Bush. You can criticize Obama but Bush started two wars that are still costing the country a fortune in $ and lives for nothing. His government deregulated everything and arguably caused a financial crisis. Trump has declared no wars. I'd call you a fool for putting him even the bottom half of a bad president list.