InvestMacro

By Rizwan Virk, Arizona State University 

Every time I read about another advance in AI technology, I feel like another figment of science fiction moves closer to reality.

Lately, I’ve been noticing eerie parallels to Neal Stephenson’s 1995 novel “The Diamond Age: Or, A Young Lady’s Illustrated Primer.”

“The Diamond Age” depicted a post-cyberpunk sectarian future, in which society is fragmented into tribes, called phyles. In this future world, sophisticated nanotechnology is ubiquitous, and a new type of AI is introduced.

Though inspired by MIT nanotech pioneer Eric Drexler and Nobel Prize winner Richard Feynman, the advanced nanotechnology depicted in the novel still remains out of reach. However, the AI that’s portrayed, particularly a teaching device called the Young Lady’s Illustrated Primer, isn’t only right in front of us; it also raises serious issues about the role of AI in labor, learning and human behavior.

In Stephenson’s novel, the Primer looks like a hardcover book, but each of its “pages” is really a screen display that can show animations and text, and it responds to its user in real time via AI. The book also has an audio component, which voices the characters and narrates stories being told by the device.

It was originally created for the young daughter of an aristocrat, but it accidentally falls into the hands of a girl named Nell who’s living on the streets of a futuristic Shanghai. The Primer provides Nell personalized emotional, social and intellectual support during her journey to adulthood, serving alternatively as an AI companion, a storyteller, a teacher and a surrogate parent.

The AI is able to weave fairy tales that help a younger Nell cope with past traumas, such as her abusive home and life on the streets. It educates her on everything from math to cryptography to martial arts. In a techno-futuristic homage to George Bernard Shaw’s 1913 play “Pygmalion,” the Primer goes so far as to teach Nell the proper social etiquette to be able to blend into neo-Victorian society, one of the prominent tribes in Stephenson’s balkanized world.

No need for ‘ractors’

Three recent developments in AI – in video games, wearable technology and education – reveal that building something like the Primer should no longer be considered the purview of science fiction.

In May 2025, the hit video game “Fortnite” introduced an AI version of Darth Vader, who speaks with the voice of the late James Earl Jones.

While it was popular among fans of the game, the Screen Actors Guild lodged a labor complaint with Epic Games, the creator of “Fortnite.” Even though Epic had received permission from the late actor’s estate, the Screen Actors Guild pointed out that actors could have been hired to voice the character, and the company – in refusing to alert the union and negotiate terms – violated existing labor agreements.

In “The Diamond Age,” while the Primer uses AI to generate the fairy tales that train Nell, for the voices of these archetypal characters, Stephenson concocted a low-tech solution: The characters are played by a network of what he termed “ractors” – real actors working in a studio who are contracted to perform and interact in real time with users.

The Darth Vader “Fortnite” character shows that a Primer built today wouldn’t need to use actors at all. It could rely almost entirely on AI voice generation and have real-time conversations, showing that today’s technology already exceeds Stephenson’s normally far-sighted vision.

Recording and guiding in real time

Synthesizing James Earl Jones’ voice in “Fortnite” wasn’t the only recent AI development heralding the arrival of Primer-like technology.

I recently witnessed a demonstration of wearable AI that records all of the wearer’s conversations. Their words are then sent to a server so they can be analyzed by AI, providing both summaries and suggestions to the user about future behavior.

Several startups are making these “always on” AI wearables. In an April 29, 2025, essay titled “I Recorded Everything I Said for Three Months. AI Has Replaced My Memory,” Wall Street Journal technology columnist Joanna Stern describes the experience of using this technology. She concedes that the assistants created useful summaries of her conversations and meetings, along with helpful to-do lists. However, they also recalled “every dumb, private and cringeworthy thing that came out of my mouth.”

These devices also create privacy issues. The people whom the user interacts with don’t always know they are being recorded, even as their words are also sent to a server for the AI to process them. To Stern, the technology’s potential for mass surveillance becomes readily apparent, presenting a “slightly terrifying glimpse of the future.”

Relying on AI engines such as ChatGPT, Claude and Google’s Gemini, the wearables work only with words, not images. Behavioral suggestions occur only after the fact. However, a key function of the Primer – coaching users in real time in the middle of any situation or social interaction – is the next logical step as the technology advances.

Education or social engineering?

In “The Diamond Age,” the Primer doesn’t simply weave interactive fairy tales for Nell. It also assumes the responsibility of educating her on everything from her ABCs when younger to the intricacies of cryptography and politics as she gets older.

It’s no secret that AI tools, such as ChatGPT, are now being widely used by both teachers and students.

Several recent studies have shown that AI may be more effective than humans at teaching computer science. One survey found that 85% of students said ChatGPT was more effective than a human tutor. And at least one college, Morehouse College in Atlanta, is introducing an AI teaching assistant for professors.

There are certainly advantages to AI tutors: Tutoring and college tuition can be exorbitantly expensive, and the technology can offer better access to education to people of all income levels.

Pulling together these latest AI advances – interactive avatars, behavioral guides, tutors – it’s easy to envision how an AI device like the Young Lady’s Illustrated Primer could be created in the near future. A young person might have a personalized AI character that accompanies them at all times. It can teach them about the world and offer up suggestions for how to act in certain situations. The AI could be tailored to a child’s personality, concocting stories that include AI versions of their favorite TV and movie characters.

But “The Diamond Age” offers a warning, too.

Toward the end of the novel, a version of the Primer is handed out to hundreds of thousands of young Chinese girls who, like Nell, didn’t have access to education or mentors. This leads to the education of the masses. But it also opens the door to large-scale social engineering, creating an army of Primer-raised martial arts experts, whom the AI then directs to act on behalf of “Princess Nell,” Nell’s fairy tale name.

It’s easy to see how this sort of large-scale social engineering could be used to target certain ideologies, crush dissent or build loyalty to a particular regime. The AI’s behavior could also be subject to the whims of the companies or individuals that created it. A ubiquitous, always-on, friendly AI could become the ultimate monitoring and reporting device. Think of a kinder, gentler face for Big Brother that people have trusted since childhood.

While large-scale deployment of a Primer-like AI could certainly make young people smarter and more efficient, it could also hamper one of the most important parts of education: teaching people to think for themselves.

About the Author:

Rizwan Virk, Faculty Associate, PhD Candidate in Human and Social Dimensions of Science and Technology, Arizona State University

This article is republished from The Conversation under a Creative Commons license. Read the original article.

By Kassem Fawaz, University of Wisconsin-Madison and Jack West, University of Wisconsin-Madison 

You wake up in the morning and, first thing, you open your weather app. You close that pesky ad that opens first and check the forecast. You like your weather app, which shows hourly weather forecasts for your location. And the app is free!

But do you know why it’s free? Look at the app’s privacy settings. You help keep it free by allowing it to collect your information, including:

• What devices you use and their IP and Media Access Control addresses.
• Information you provide when signing up, such as your name, email address and home address.
• App settings, such as whether you choose Celsius or Fahrenheit.
• Your interactions with the app, including what content you view and what ads you click.
• Inferences based on your interactions with the app.
• Your location at a given time, including, depending on your settings, continuous tracking.
• What websites or apps that you interact with after you use the weather app.
• Information you give to ad vendors.
• Information gleaned by analytics vendors that analyze and optimize the app.

This type of data collection is standard fare. The app company can use this to customize ads and content. The more customized and personalized an ad is, the more money it generates for the app owner. The owner might also sell your data to other companies.

You might also check a social media account like Instagram. The subtle price that you pay is, again, your data. Many “free” mobile apps gather information about you as you interact with them.

As an associate professor of electrical and computer engineering and a doctoral student in computer science, we follow the ways software collects information about people. Your data allows companies to learn about your habits and exploit them.

It’s no secret that social media and mobile applications collect information about you. Meta’s business model depends on it. The company, which operates Facebook, Instagram and WhatsApp, is worth US$1.48 trillion. Just under 98% of its profits come from advertising, which leverages user data from more than 7 billion monthly users.

What your data is worth

Before mobile phones gained apps and social media became ubiquitous, companies conducted large-scale demographic surveys to assess how well a product performed and to get information about the best places to sell it. They used the information to create coarsely targeted ads that they placed on billboards, print ads and TV spots.

Mobile apps and social media platforms now let companies gather much more fine-grained information about people at a lower cost. Through apps and social media, people willingly trade personal information for convenience. In 2007 – a year after the introduction of targeted ads – Facebook made over $153 million, triple the previous year’s revenue. In the past 17 years, that number has increased by more than 1,000 times.

Five ways to leave your data

App and social media companies collect your data in many ways. Meta is a representative case. The company’s privacy policy highlights five ways it gathers your data:

First, it collects the profile information you fill in. Second, it collects the actions you take on its social media platforms. Third, it collects the people you follow and friend. Fourth, it keeps track of each phone, tablet and computer you use to access its platforms. And fifth, it collects information about how you interact with apps that corporate partners connect to its platforms. Many apps and social media platforms follow similar privacy practices.

Your data and activity

When you create an account on an app or social media platform, you provide the company that owns it with information like your age, birth date, identified sex, location and workplace. In the early years of Facebook, selling profile information to advertisers was that company’s main source of revenue. This information is valuable because it allows advertisers to target specific demographics like age, identified gender and location.

And once you start using an app or social media platform, the company behind it can collect data about how you use the app or social media. Social media keeps you engaged as you interact with other people’s posts by liking, commenting or sharing them. Meanwhile, the social media company gains information about what content you view and how you communicate with other people.

Advertisers can find out how much time you spent reading a Facebook post or that you spent a few more seconds on a particular TikTok video. This activity information tells advertisers about your interests. Modern algorithms can quickly pick up subtleties and automatically change the content to engage you in a sponsored post, a targeted advertisement or general content.

Your devices and applications

Companies can also note what devices, including mobile phones, tablets and computers, you use to access their apps and social media platforms. This shows advertisers your brand loyalty, how old your devices are and how much they’re worth.

Because mobile devices travel with you, they have access to information about where you’re going, what you’re doing and who you’re near. In a lawsuit against Kochava Inc., the Federal Trade Commission called out the company for selling customer geolocation data in August 2022, shortly after Roe v Wade was overruled. The company’s customers, including people who had abortions after the ruling was overturned, often didn’t know that data tracking their movements was being collected, according to the commission. The FTC alleged that the data could be used to identify households.

Kochava has denied the FTC’s allegations.

Information that apps can gain from your mobile devices includes anything you have given an app permission to have, such as your location, who you have in your contact list or photos in your gallery.

If you give an app permission to see where you are while the app is running, for instance, the platform can access your location anytime the app is running. Providing access to contacts may provide an app with the phone numbers, names and emails of all the people that you know.

Cross-application data collection

Companies can also gain information about what you do across different apps by acquiring information collected by other apps and platforms.

This is common with social media companies. This allows companies to, for example, show you ads based on what you like or recently looked at on other apps. If you’ve searched for something on Amazon and then noticed an ad for it on Instagram, it’s probably because Amazon shared that information with Instagram.

This combined data collection has made targeted advertising so accurate that people have reported that they feel like their devices are listening to them.

Companies, including Google, Meta, X, TikTok and Snapchat, can build detailed user profiles based on collected information from all the apps and social media platforms you use. They use the profiles to show you ads and posts that match your interests to keep you engaged. They also sell the profile information to advertisers.

Meanwhile, researchers have found that Meta and Yandex, a Russian search engine, have overcome controls in mobile operating system software that ordinarily keep people’s web-browsing data anonymous. Each company puts code on its webpages that used local IPs to pass a person’s browsing history, which is supposed to remain private, to mobile apps installed on that person’s phone, de-anonymizing the data. Yandex has been conducting this tracking since 2017, while Meta began in September 2024, according to the researchers.

What you can do about it

If you use apps that collect your data in some way, including those that give you directions, track your workouts or help you contact someone, or if you use social media platforms, your privacy is at risk.

Aside from entirely abandoning modern technology, there are several steps you can take to limit access – at least in part – to your private information.

Read the privacy policy of each app or social media platform you use. Although privacy policy documents can be long, tedious and sometimes hard to read, they explain how social media platforms collect, process, store and share your data.

Check a policy by making sure it can answer three questions: what data does the app collect, how does it collect the data, and what is the data used for. If you can’t answer all three questions by reading the policy, or if any of the answers don’t sit well with you, consider skipping the app until there’s a change in its data practices.

Remove unnecessary permissions from mobile apps to limit the amount of information that applications can gather from you.

Be aware of the privacy settings that might be offered by the apps or social media platforms you use, including any setting that allows your personal data to affect your experience or shares information about you with other users or applications.

These privacy settings can give you some control. We recommend that you disable “off-app activity” and “personalization” settings. “Off-app activity” allows an app to record which other apps are installed on your phone and what you do on them. Personalization settings allow an app to use your data to tailor what it shows you, including advertisements.

Review and update these settings regularly because permissions sometimes change when apps or your phone update. App updates may also add new features that can collect your data. Phone updates may also give apps new ways to collect your data or add new ways to preserve your privacy.

Use private browser windows or reputable virtual private networks software, commonly referred to as VPNs, when using apps that connect to the internet and social media platforms. Private browsers don’t store any account information, which limits the information that can be collected. VPNs change the IP address of your machine so that apps and platforms can’t discover your location.

Finally, ask yourself whether you really need every app that’s on your phone. And when using social media, consider how much information you want to reveal about yourself in liking and commenting on posts, sharing updates about your life, revealing locations you visited and following celebrities you like.

This article is part of a series on data privacy that explores who collects your data, what and how they collect, who sells and buys your data, what they all do with it, and what you can do about it.

Kassem Fawaz, Associate Professor of Electrical and Computer Engineering, University of Wisconsin-Madison and Jack West, PhD Student in Computer Science, University of Wisconsin-Madison

This article is republished from The Conversation under a Creative Commons license. Read the original article.