I've been thinking about this a lot as well. I'm less worried about people liking algorithms because they add convenience (I can even understand this), although I think relying on them or advocating for them in all spaces is deeply short-sighted. I am worried about how they will be used in ways people aren't anticipating (or that we can anticipate but people don't weight heavily). I think about how the DHS got around restrictions on directly monitoring people's data by going around and paying the private companies for the data they collect for advertising purposes. I think about how the ability to opt-out of these systems may be restricted in the future. If we can opt out, then we're dealing with folks preferences that we may not like (and I agree it is a negative social effect, so to speak, and not a feature I enjoy in fandom or social spaces) but ultimately preferences for how people manage their own behavior is just not where my energy is focused, insofar as it does not lead to them harming other people by those choices. It's when it stops being a choice, because it is mandated, that I get really worried. I do think we've only seen the very early stages of what can be done with tracking people, including deportations and criminalization, and to think about how an authoritarian system uses it (including in other countries) is the part that worries me. I wish it was a question of education, but if it's preferences - and people just prefer to let other people (via algorithm writing) curate their lives, that feels like a much bigger problem to me than just having the wool pulled over their eyes. It makes me think of the argument that the problem with conservative women is just that they've been taught one way, and that if they only awaken to the true ideas, they'll agree with the other side (I can't remember the name for this theory right now, but it's something to do with subconsiousness?) - but that's almost the idealistic optimistic approach, because the alternative is that that is what they want and value and believe in. I also don't really get how you could not be aware this is a debate (especially for folks who are adults), which seems to indicate a lack of questioning about the world and not just about how social media is curated these days.
no subject