Short answer: yes, that’s how it works. Just dump the files in the htdocs folder and it should load.
If you did that and it doesn’t work, could you please share your website URL, a screenshot of what you see on your website and a screenshot of the directory listing in the htdocs folder?