Fun with robots.txt

By -

Columnist Patrick Stox provides some dos and don'ts for creating your robots.txt file -- along with examples of companies who have gotten creative with their files.

The post Fun with robots.txt appeared first on Search Engine Land.



from Channel: SEO – Search Engine Land http://selnd.com/2fFn9Vf
via SEO In Mumbai

Comments

Post a Comment

Popular posts from this blog

How To Do Local SEO for Businesses Without Physical Locations in 2021

By -
Image
Posted by MiriamEllis “My business makes local deliveries, but doesn’t have a storefront. How do I handle listings management?” “I work from home. How should I be doing local SEO?” “Are there any tips for doing local SEO for clients like NerdWallet or Credit Karma that serve all customers virtually?” Queries like these about doing local SEO for businesses with nuanced, hidden, or no physical locations and with varied models of customer fulfillment are AMA FAQs and perennial topics on marketing fora. Attendees at the recent Moz Webinar on The ROI of Local SEO repeatedly asked about this subject. Business owners and marketers who haven’t serendipitously discovered Google’s various guidelines are left wondering how to promote non-brick-and-mortar brands. Even where there’s awareness that such guidance exists, Google is continually evolving its stance. It’s easy to make mistakes, overlook updates, and miss out on opportunities. The great news is, there are local marketing possibilit
Read more

The Fundamentals of Crawling for SEO – Whiteboard Friday

By -
Image
In this week’s episode of Whiteboard Friday, host Jes Scholz digs into the foundations of search engine crawling. She’ll show you why no indexing issues doesn’t necessarily mean no issues at all, and how — when it comes to crawling — quality is more important than quantity. Click on the whiteboard image above to open a high resolution version in a new tab! Video Transcription Good day, Moz fans, and welcome to another edition of Whiteboard Friday. My name is Jes Scholz, and today we're going to be talking about all things crawling. What's important to understand is that crawling is essential for every single website, because if your content is not being crawled, then you have no chance to get any real visibility within Google Search. So when you really think about it, crawling is fundamental, and it's all based on Googlebot's somewhat fickle attentions. A lot of the time people say it's really easy to understand if you have a crawling issue. You log in to
Read more

Great Content ≠ Long-Form Content

By -
Posted by randfish [Estimated read time: 2 minutes] Yes. I've read the studies. I know the correlations. Long-form content, on average, earns more engagement, higher rankings, and more shares than their more concise brethren. Not sure where the idea that "great content" = "really, really long content" came from, but we need to dispel that myth. — Rand Fishkin (@randfish) March 30, 2016 But, that does not make long-form content the same as great content. It does not make long-form content the goal of every content effort. It certainly does not mean that longer content is better content. Confounding variables are, in my opinion, behind many of these correlations. Long-form content, at least the good stuff, intentionally targets searchers and browsers seeking lengthier, more comprehensive information. If you want to challenge those "longer content performs better on average" statistics with equally unapplicable numbers, check the data on dimin
Read more