If you're just starting into web publishing, building web pages, etc., you may find free hosts such as Geocities a good way to start out. At least if you don't like it or figure out that maintaing a site is a lot of work, you can stop and it didn't cost you anything. The drawback to hosts such as Geocities is that they do limit what they offer for free and they make you include their advertisements on your web pages... or at least they used to... it's been a while since I've checked out their deal.
On the other hand, you may already have decided that no matter what, you are wanting your own web site and money is no obstacle. You'll find that there are hundreds or thousands of companies that will host your site. Choose carefully. I've found that price isn't everything. You want support and a proven record of uptime more than anything. You want a server that will load your pages rapidly. My advice would be to find someone you trust with a website and ask them who they are using. The fees are variable depending upon where you decide to setup house. Typical maintenance fees are somewhere in the neighboorhood of $15-25 per month. You can usually prepay this annually and get some kind of discount.
To get your own domain name, you will have to find a unique name that doesn't already exist and pay a registration fee to reserve it in your name. This might be hard, because there are domain name brokers out their buying up names that they hope to sell to you for a premium price. Could be 10's of thousands if you have to have some desirable name. But, lets say that you have a name picked out that no one has thought of yet such as 'www.konradfinancewebpage.com' (which is available), you can register it by yourself for a fee of about $20/year. Sometimes you can get a discount if you sign up for your domain name with a hosting service at the same time. It is usual to register for 5 - 10 years at a time. Say you want to keep your domain name where no one else can use it and you have exclusive right to it for 5 years. It might cost you $80-100 total.
What else? I've done this stuff many times before.
Traders' Consortium