• 1

Read this first!

We do not monitor these forums. The forum is provided to exchange information and experience with other users ONLY. Forum responses are not guaranteed.

However, please submit a ticket if you have an active subscription and wish to receive support. Our ticketing system is the only way of getting in touch with RSJoomla! and receiving the official RSJoomla! Customer Support.

For more information, the Support Policy is located here.

Thank you!

TOPIC: What to do with bad url's?

What to do with bad url's? 13 years 8 months ago #11314

  • Mr.Jinx
  • Mr.Jinx's Avatar
  • OFFLINE
  • Fresh Boarder
  • Posts: 9
I have been running RSSeo! for a while now, and I like the way you can get "100% scores" for all your pages.
This helps me making good descriptions/keywords for every page.

However, I keep getting more and more pages with weird URL's.
I'm using joomla's build in SEF, and I have excluded all pages with '?' in the URL.

For example, I have a page on www.example.com/page1.
Somehow, the crawler is also indexing www.example.com/page1/65 which generates a different page. I do not have a link anywhere to www.example.com/page1/65.

I'm also getting these weird urls : www.example.com/page1/' uri '

Is there a way to stop these pages from being crawled by search engines (to prevent duplicate content)?
The administrator has disabled public write access.

Re:What to do with bad url's? 13 years 8 months ago #11338

  • bogdanc
  • bogdanc's Avatar
  • OFFLINE
  • Moderator
  • Posts: 669
  • Thank you received: 11
Hello,

You can try deleting the respective pages from RSSEO! > Pages. Now you can disable the Auto Crawler from the component, from RSSEO! > Settings > Crawler. Now the new pages that you access on your site will not be automatically added to the component.
The administrator has disabled public write access.

Re:What to do with bad url's? 13 years 5 months ago #12074

  • Josh
  • Josh's Avatar
  • OFFLINE
  • Fresh Boarder
  • Posts: 1
Hmmm, then how do you add new pages that you want crawled?

Thanks!
The administrator has disabled public write access.

Re:What to do with bad url's? 13 years 5 months ago #12126

  • alexp
  • alexp's Avatar
  • OFFLINE
  • RSJoomla! Official Staff
  • Posts: 2253
  • Thank you received: 180
Hello,

You can set filtering rules when crawling. These setting are available here:

Components > RSSeo! > Settings > Crawler: Ignore links when crawling
Please note: my help is not official customer support. To receive your support, submit a ticket by clicking here
Regards,
RSJoomla! Development Team
The administrator has disabled public write access.

Re: What to do with bad url's? 12 years 7 months ago #14994

  • studio72
  • studio72's Avatar
  • OFFLINE
  • Fresh Boarder
  • Posts: 2
but surely google can still find them and index them causing duplicate content? i have this same problem and not sure how to get round it?
The administrator has disabled public write access.
  • 1

Read this first!

We do not monitor these forums. The forum is provided to exchange information and experience with other users ONLY. Forum responses are not guaranteed.

However, please submit a ticket if you have an active subscription and wish to receive support. Our ticketing system is the only way of getting in touch with RSJoomla! and receiving the official RSJoomla! Customer Support.

For more information, the Support Policy is located here.

Thank you!