Still didn't work.
I set the specific permissions on the directory so that the ftp user could read but not write.
But the ftp user should be able to already because i have "authenticated users" set to full control.
And I want this to work, I'm not going to give up. This thing HAS to work, lots of people and companies use it, I'm just overlooking something.