check availability of sitemap file in website through ASP.NET

Question

I want to check the availability of sitemap.xml and robot.txt file on hosted server and I'm working on SEO project where user put URL and in return the availability of these two file will Show Some Message . Please give me some example

Answer 1

If I understood your question correctly then you require a function in ASP.net which can tell you if a url exist or not. Which can be used to findout for the following url if exist/not exist

<website>/sitemap.xml
<website>/robot.txt

Check this code which would be handy and will return true or false if provided url exist or not exist.

protected bool CheckUrlExists(string url)
    {
        // If the url does not contain Http. Add it.
        if (!url.Contains("http://"))
        {
            url = "http://" + url;
        }
        try
        {
            var request = WebRequest.Create(url) as HttpWebRequest;
            request.Method = "HEAD";
            using (var response = (HttpWebResponse)request.GetResponse())
            {
                return response.StatusCode == HttpStatusCode.OK;
            }
        }
        catch 
        {
            return false;
        }
    }

Please let me know if it does not satisfy your need.

Comments

thanx... One more thing this is a standard way to find these two files ? and If we found 404 Error what does that Mean ?

---

From the problem statement I assume that you need the url finder, and this could be one of the simplest way to achieve.