Aware's analytics tool — the one that monitors employee sentiment and toxicity — doesn't have the ability to flag individual employee names, according to Schumann. Speaking broadly about employee surveillance AI rather than Aware's technology specifically, Williams told CNBC: "A lot of this becomes thought crime." When including other types of content being shared, such as images and videos, Aware's analytics AI analyzes more than 100 million pieces of content every day. "It's always tracking real-time employee sentiment, and it's always tracking real-time toxicity," Schumann said of the analytics tool. Amba Kak, executive director of the AI Now Institute at New York University, worries about using AI to help determine what's considered risky behavior.

---

Persons: George Orwell, there's, Slack, Jeff Schumann, Schumann, Jutta Williams, Williams, chatbot, he's, Orwell, Rather, Amba Kak, Kak, they're Organizations: Istock, Microsoft, U.S, Walmart, Delta Air Lines, Mobile, Chevron, Starbucks, Nestle, AstraZeneca, CNBC didn't, Delta, CNBC, Humane Intelligence, Goldman Sachs Asset Management, Nationwide, CBS, Meta, New York University, Federal Trade Commission, Justice Department, Opportunity Commission Locations: Columbus , Ohio, Chevron, United States, Slack