Protecting files directory, but allow server side access

I have a files directory that stores PDFs and doc files. Users that log into my website can download and upload files to/from this directory and never visit the file URL. I want to be able to restrict access to files via the address bar, but allow my code (pages on the same server) access to the directory.

Is this something that can be done?

Thank you in advance for your help.