this post was submitted on 02 May 2024
1108 points (98.5% liked)

Technology

59589 readers
3148 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS
 

Statcounter reports that Windows 11 continues to lose its market share for the second month in a row. Windows 10, meanwhile, is gaining more users and is now back above the 70% mark.

you are viewing a single comment's thread
view the rest of the comments
[–] MudMan@fedia.io 51 points 6 months ago* (last edited 6 months ago) (3 children)

Okay, this seemed wrong. As the article said, even Win8 didn't go down in usage over time. So I went and checked the methodology for the source data.

Turns out, this number is based on social media and search engine referral data. Also turns out, they warn that while they do track Bing chat referrals when you follow through a link, they don't see chat responses where you only read the AI response but don't click through:

We have no way of measuring the number of queries performed in bing chat. However, we also don't measure the number of queries to regular search engines like bing or google either. Instead we track search engine referrals.

i.e. If you go to a search engine and do a search for anything and you click on a website result, we'll record that click as a search engine referral if that website had the statcounter code installed. It's the click to a website that we measure, not the actual search queries that were performed.

When you do a search using bing chat, and you click on one of the "learn more" websites we can track that as a search referral. So we are monitoring bing chat in the same way we measure the regular bing search engine.

From this data we can see from the statcounter network of webites, that the amount of traffic being sent to websites from bing chat is very, very small. Less than 1/100 of 1 percent.

So from our data we can say that bing chat is not currently translating into enough clicks to our network of websites to change the search share.

Of course you are less likely to click on a source website from bing chat than a regular search, as it is intended to give you the answer rather than have you go visiting websites to find the answer. So that needs to be factored in when using our stats for your analysis.

That is very interesting. That's a likely culprit for Win11 specifically to have gone down a couple of percentage points in the US and EU (the other territories seem to remain flat), but it's hard to prove.

It's also a bit concerning in terms of measuring the effects of AI search in both network traffic and in how search results are consumed. If that's the cause it does suggest that AI chat users are less likely to follow through to the source info, which seems risky, although it's also hard to prove what that does to receiving truthful info.

Lots of counterintutitive, hard to parse implications from this one data point, but I'd be surprised if it was as simple as "people have randomly decided to roll back to Win10 (and Win8, which also grows) for no reason".

[–] gila@lemm.ee 23 points 6 months ago (1 children)

I think we just need to move on from this methodology of data collection. Firefox is often cited as very unpopular because it blocks statcounter tracking by default, social networks have absorbed some search volume too. I do think it makes logical sense that people are dropping 11; I did so myself last year. But this data is likely bad, so it's pointless to try and extract a reason based on it.

[–] MudMan@fedia.io 12 points 6 months ago* (last edited 6 months ago)

Well, a data point is a data point is a data point. You just can't make all your decisions based on a single one, at least without understanding what's behind it.

FWIW, the Steam survey has Win 11 growing by 3.5% last month, with Win10 going down by about the same amount (Linux stays at 1.9% there). Neither data source is wrong or bad, necessarily, but you do want to be aware that one is an opt-in survey of gamers and the other is a tracker of search engine referrals.

So the takeaway is that people are probably not deserting Win 11 in droves, but maaaybe their use of online search is being impacted by MS's integration of AI search or something else changing Win11 users' behavior around social media or search engines. Or mostly that it may be too early to tell and we may need more sources of info. For all the glee and schadenfreude in this thread, the big teachable moment is that data and stats are nuanced and hard to read and that confirmation bias is a bitch.

load more comments (1 replies)