Skip to main content
Back to timeline
Sierra blogSource publication:

Ghostwriter turns agent operations into a teammate: it watches performance in Slack, traces root causes, and drafts and tests fixes

Synopsis

Ghostwriter is an AI teammate that works alongside teams in Slack and Teams, continuously checking conversations, releases and metrics against the goals each team sets, raising issues before customers report them, tracing root causes, and drafting and testing fixes for the right person to review. Across five customers, the common thread is that by the time someone sits down to look at a problem, Ghostwriter has usually found it, understood the cause, or drafted a change to fix it.

Source-provided article image: Ghostwriter’s performance review
Sierra

Interpretation

Ghostwriter shifts day-to-day agent operations from waiting for customer complaints to continuously checking against team-set goals, so problems surface in the team channel even when no one is watching. Most teams previously learned about agent problems only when a customer complained. At ShipStation Global this cut down how much the team reviews by hand; at Carta, it posted one morning that the chat agent was failing to create support cases, had already listed the affected customers, and later confirmed recovery.

After spotting a problem, Ghostwriter traces it to its source, whether that is how the journey was built or a system the agent depends on, and lays out what it found in the thread. The slow part of troubleshooting is often working out why something looks off, not noticing the anomaly. At Tilt, a question sent from a phone was enough to get an issue diagnosed and handed off.

Ghostwriter does not stop at diagnosis: it drafts the change, tests it first, and tags the right person to review it, whether it spotted the problem itself or someone on the team asked. Teams previously had to dig through journeys and settings to work out why the agent did what it did. At Airtable the reported result is speed; the ShipStation Global team spends less time digging through journeys and settings because each fix arrives already tested.

After a change goes live, Ghostwriter keeps tracking each experiment and release and reports back on whether it made a difference. Post-release verification is carried continuously by Ghostwriter rather than checked once. Imprint, which partners with some of the largest brands in the world, uses this to maintain quality as more people work on its agent.

Perspective

The scope is limited to usage feedback from five customers (ShipStation Global, Carta, Tilt, Airtable and Imprint) and to how Ghostwriter checks, diagnoses, drafts fixes and tracks releases in Slack and Teams; these are customer accounts of use, not a controlled evaluation.

The feedback is mostly qualitative, with no quantitative metrics or comparison against manual operations; Ghostwriter learns more about how a team works the longer it works with that team, and that learning effect has not been measured on its own.