Archive for the 'Yahoo' Category

Missing categories in Google’s Directory

on Monday, June 4th, 2007

I was checking for the Free Content category on DMOZ.org and I saw it’s updated. I also tried the check the google version. Big surprise! The category does not exist in google’s dmoz copy.

I’m not sure if this is on purpose, but it’s most likely that google is also moderating the biggest moderated directory on the net. Hehe that’s a good one.

See it yourself (I’m not sure for how long this links will be alive)
Dmoz link : updated around June 4th
Google’s Link: doesn’t exist as of June 5th

Also I’ve found if you search for url that exist on dmoz’s certain category, google returns a result but the link is simply for oh for.
See the first link.

Last notes: Yahoo’s directory doesn’t have the category too. I kind of understand it since the category is under Business branch and it’s a paid service for yahoo to appear under that branch.

More sitemap issues!

on Thursday, April 19th, 2007

It’s a jungle out there!
Now I realized, yahoo is indexing the sitemap directly at the search results!!!!!!!!
this is redicilous.
Check this link the last entry is from my sitemap.

Sitemaps in the robots.txt Happy Harvesting

on Wednesday, April 11th, 2007

I’ve just read the Google Webmaster’s blog about the news on ask.com supporting Sitemaps.org’s sitemap format.
This is really a great news for all the people that like to be crawled faster and acurately.
For me the more interesting part about this news is that sitemaps.org’s proposal to include sitemaps into the robots.txt.

Simply you add a line into your robots.txt saying

Sitemap: <sitemap_location></sitemap_location>

This part is really cool but for site harvesters it’s an unbelivable tool. So you can handover the key to your site and web harvesters can crawl your site really easily because probably you’ve put all your site’s pages into your sitemap.

Sounds like a good plan in an ideal world. With all the cloakers and content scrapers you must be really smart not to be ripped apart.

My suggestion is to know who you’re serving the sitemap. Currently Google, Yahoo and Ask is supporting this sitemaps.xml and no other site has anything to do with it.
Here is a simple check you can add in the begining of your sitemap thing:

< ?php
    function botIsAllowed($ip){
        //get the reverse dns of the ip.
        $host = strtolower(gethostbyaddr($ip));
        $botDomains = array('.inktomisearch.com', 
                                     '.googlebot.com', 
                                     '.ask.com',
                             );
        
        //search for the reverse dns matches the white list
        foreach($botDomains as $bot){
            if (strpos(strrev($host),strrev($bot))===0){
                $qip= gethostbyname($host);
                return ($qip==$ip);
            }
        }
        return false;
}

if (!botIsAllowed($_SERVER['REMOTE_ADDR'])){
    echo "Banned!";
    exit;
}
?>

I’m sure everyone can get the idea of reverse dns and forward dns checking.
If I missed any decent site that uses the sitemaps let me know.

Note: If you’re still using static sitemaps (!) you can just include the xml after the code.

Things to look out for when building a large application

on Thursday, February 9th, 2006

Joshua Schachter from del.icio.us has really nice notes for the ones that are looking for it.

These are the things to look out for when building a large application on web. Most of them I agree, some of them I don’t. This list also should keep in mind that, real world problems are not that perfect. I marked the ones that I strongly agree with an asterix (*).
I also filtered out the things are specific to del.icio.us from the original text.

Read more…

Google AdSense Account Disabled ?!?!!!

on Saturday, January 21st, 2006

It was a regular day that I checked my google adsense account and I saw that message:

No AdSense Account
An AdSense account does not exist for this login, as you have not yet completed an application. If you are using your AdWords login, you can create an AdSense account with the same login.

I was really confused, I checked my emails an the bad news: Google AdSense Account Disabled.
Read more…

Yahoo! Maps Pranks Google

on Monday, November 7th, 2005

According to Silicon Valley Sleuth, Yahoo!’s new maps service (which I covered here) had a bogus local business listing for Google: “The Dude’s Fish Store”. The Sleuth’s web site has a screen shot, but I found more proof (and more irony) by Googling for “The Dude’s Fish Store”–it showed up in Yahoo! Local’s list of “Toys in Mountain View” (View image). It’s gone now, but I love that Google’s own index preserved the prank against them.

link

Yahoo Podcasting

on Tuesday, October 11th, 2005

Here is a new thing from Yahoo.

Yahoo Podcasting

Konfabulator

on Tuesday, July 26th, 2005

Here is another desktop organizer…

I’m very my much amazed by the potential of this tool…
Also recently they are sold to Yahoo and Konfabulator is free…
Worths checking…

Yahoo Widgets
Konfabulator

Marketers See Opportunity as a Web Tool Gains Users

on Tuesday, July 5th, 2005

Really good article

THE fledgling R.S.S. business is starting to attract some attention from those catering to Internet advertisers.

Google, Pheedo, Feedster and Yahoo Search Marketing are all peddling advertising options for R.S.S., an increasingly popular way of having a personal computer automatically retrieve information from the Internet.

For example, R.S.S. users interested in local weather could view forecast updates on their computers without having to visit a particular Web site.

Some big companies, like Verizon, are starting to buy space in the R.S.S. information streams, which are selected anonymously and pulled from Web sites by a PC.

please read the rest of this article from NY Times

Yahoo Search Marketting

on Saturday, July 2nd, 2005

Reminds me of a blog page but their design is really cool.
Check Yahoo Search marketting home page and also their 50$ off page