What Happened
A cyberattack on Fireworks AI, a platform that lets developers use open‑AI models, breached a third‑party cloud provider. The attacker gained access to Fireworks’ development system and accessed customer data, including billing information and datasets.
Details of the Breach
- Fireworks’ security advisory notes the breach began on October 23 when a third‑party cloud provider was compromised.
- Unauthorized access allowed the attacker to reach Fireworks’ development machines and run an unauthorized workload.
- Investigations revealed that billing data—addresses, invoices, payment history, account balances and credit usage—was accessed. Payment card numbers were not stored by Fireworks and were not impacted.
- For a limited set of accounts, secrets, datasets and incomplete model weights were also accessed.
- The breach is believed to be linked to a financially motivated threat‑actor group engaged in “LLMJacking,” selling tokens from unauthorized LLM access.
Impact on Notion Customers
Notion, an online document editor, confirmed that the incident affected about 1% of its customers. The breach exposed chat transcripts from users who employed Notion’s “Insights” AI feature. These transcripts contain any input to or output from the model that was written to the chat. Much of the data could not be attributed to specific customers.
Fireworks AI Response
Fireworks notified law enforcement and worked with Palo Alto Networks Unit 42 to conduct forensic analysis. The company revoked and replaced credentials, tightened privilege controls, isolated affected systems, and enhanced logging. It disabled self‑serve dataset uploads and downloads while keeping the Training SDK available with zero‑data‑retention policies.
Notion’s Mitigation Steps
On November 3, Notion disconnected its systems from Fireworks, deleted the data stored in its own systems, and stopped all connectivity between the two. The company issued a security bulletin and provided affected workspace owners with tools to review and download exposed data, including CSV files with message roles, text, and metadata. Workspace owners can also generate links to share the data with affected members.
Background on Fireworks AI
Fireworks AI has tens of thousands of customers worldwide, including legal‑tech firm Harvey and AI company Cursor. This incident marks the second breach in as many months, following a security incident in October.
Implications for the AI Ecosystem
The breach illustrates how reliance on third‑party providers can expose customers to downstream attacks. It also highlights the growing threat of LLMJacking, where attackers sell unauthorized access tokens to large‑language‑model services. Companies using AI platforms must review their supply‑chain security and monitor for similar incidents.
