You can have a single error page for your website rather than individual error pages for each error (403, 404, 500, etc.).
When you create the desired universal error page with a text/HTML editor of your choice, you have to upload it into a subdirectory of your public_html called errors. Make sure to name the universal error page error.php.
Then you have to open your main .htaccess file and add the following lines in it:
# provide a universal error document
RewriteCond %{REQUEST_FILENAME} !-f
RewriteCond %{REQUEST_FILENAME} !-d
RewriteRule ^.*$ /errors/error.php [L]
Joomla is a powerful software that is easy to work with once you have the right host to support you. Before you lose any more time with the wrong host, check out the SiteGround Joomla hosting offer.