Internal Agents Map

Sidekick

Sidekick is HubSpot's internal AI code reviewer, built by its Developer Experience AI team. It runs on every pull request in GitHub. A second Judge Agent evaluates each draft comment for succinctness, accuracy, and actionability, and only comments that pass are posted.

Company
HubSpot
Approach type
Agent
Human involvement
Drafts reviewed
Invocation
Event-driven
Interfaces
Github
Deployment stage
Scaled
Evidence strength
Detailed primary
Entry reviewed
Copy as MDAsk ChatGPT

How it works

Pull request opened → Sidekick draft review → judge-gated comments posted to GitHub.

Trigger review

Review runs automatically when a pull request is created or marked ready for review, or when Sidekick is requested as a reviewer[Source 1, Source 2]

Draft the review

Sidekick produces the initial review of the pull request[Source 1]

Post passing comments

Only comments that pass the judge evaluation are posted to GitHub; the rest are filtered out[Source 1]

Where people stay involved

People review, approve, or guide the agent’s work here.

Not reported: The review flow is automated end to end. The captures document post-hoc emoji and thread feedback on comments (source 1, lines 103–108) and continued human review for system design and architecture (line 12), but no required human checkpoint inside the review flow.

  • Supervision level

    Work-product review

    A person reviews the draft or implementation.

    Level 3 of 5

    • pull request → AI review comments[Source 1]

How supervision levels work

Implementation details

Model
Not reportedNo capture states which model the review runs on. Multi-model support (Claude, GPT, Gemini) is a capability of the Aviator framework (source 1, line 45), not a statement about this reviewer.
Harness
Aviator, an internal Java agent framework; replaced the earlier Claude Code review implementation on Crucible[Source 1]
Sandbox
Not reportedExecution isolation of the Aviator runtime is not documented. The Kubernetes sandboxing described in source 2 (lines 30–37) covers the earlier Crucible implementation.
Tool access
Aviator framework for precise tool control[Source 1]
Knowledge
Optional repo-specific custom instructions can be incorporated into the review prompt; the feature recently launched[Source 1]
Context management
Not reportedThe captures describe no mechanism that maintains or organizes context for the reviewer over time.
Credentials
Not reported
Interfaces
  • github
[Source 1]

Validation and failure handling

Judge each draft comment

A second Judge Agent evaluates every draft comment for succinctness, accuracy, and actionability[Source 1]

Reported observations

These results come from the sources. Notes below each result explain what it covers and any reported limits.

Headline claim

Reviews every pull request and cut engineer feedback time by 90%[Source 1]

Reported by
HubSpot
Scope
Time for engineers to receive code feedback from Sidekick; not overall PR completion time

The source does not report the denominator of this figure.

Observed in March 2026

About this result
Category
Cost latency
Evidence type
Reported measurement
What it covers
Sidekick review coverage of HubSpot pull requests and the time engineers wait for feedback
Key observation

Over 80% thumbs-up reaction rate on review feedback during the preceding couple of months[Source 1]

Reported by
HubSpot
Scope
Developer emoji reactions on review comments during the preceding couple of months
Denominator
Thumbs-up and thumbs-down reactions; not all developers or all reviews
Method
Emoji reactions and replies on review comments
About this result
Category
Effectiveness
Evidence type
Reported measurement
What it covers
Developer thumbs-up share of reactions on Sidekick review comments over the preceding couple of months

Lessons

Reported opinion: Unhelpful rather than incorrect feedback was the most common failure mode; prompt tuning alone could not eliminate it, and a second judge agent filtering draft comments was the single most important factor in review effectiveness[Source 1]

Back to agents
Improve this record

Give your coding agent the context and instructions to prepare a source-backed update.

Paste the prompt into your coding agent, then describe the correction or add a public source.

Preview prompt

Sources and research details

Citations link to the original publisher. Each source also keeps a preserved copy in the repository, so a changed or removed page stays checkable.

  1. Automated code review, the 6-month evolutionhttps://product.hubspot.com/blog/automated-code-review-the-6-month-evolutionEngineering blog · First party · Last source verification: 2026-08-31
  2. Cloud coding agents at HubSpothttps://product.hubspot.com/blog/cloud-coding-agents-at-hubspotEngineering blog · First party · Last source verification: 2026-08-31
Question coverage and scope
purpose
Reported
workflow
Reported
human involvement
Not reported: The review flow is automated end to end. The captures document post-hoc emoji and thread feedback on comments (source 1, lines 103–108) and continued human review for system design and architecture (line 12), but no required human checkpoint inside the review flow.
implementation
Reported
validation
Reported
observations
Reported
lessons
Reported
Research details for every claim on this page
  1. Summary
    Statement type
    Fact
    Provenance
    Reported
    Confidence
    Not assessed
    Confidence reason
    No explicit confidence assessment is recorded for this claim.
  2. Headline claim
    Statement type
    Metric
    Provenance
    Reported
    Confidence
    Medium
    Confidence reason
    HubSpot reported the figures in its own engineering blog without independent verification.
    Reported by
    HubSpot
    Scope
    Time for engineers to receive code feedback from Sidekick; not overall PR completion time
    Denominator
    Not reported
    Method
    Not reported
    Observation date
    2026-03
  3. Harness
    Statement type
    Fact
    Provenance
    Reported
    Confidence
    Not assessed
    Confidence reason
    No explicit confidence assessment is recorded for this claim.
  4. Tool access
    Statement type
    Fact
    Provenance
    Reported
    Confidence
    Not assessed
    Confidence reason
    No explicit confidence assessment is recorded for this claim.
  5. Interfaces
    Statement type
    Fact
    Provenance
    Reported
    Confidence
    Not assessed
    Confidence reason
    No explicit confidence assessment is recorded for this claim.
  6. Knowledge
    Statement type
    Fact
    Provenance
    Reported
    Confidence
    Not assessed
    Confidence reason
    No explicit confidence assessment is recorded for this claim.
  7. Trigger review
    Statement type
    Fact
    Provenance
    Reported
    Confidence
    Not assessed
    Confidence reason
    No explicit confidence assessment is recorded for this claim.
  8. Draft the review
    Statement type
    Fact
    Provenance
    Reported
    Confidence
    Not assessed
    Confidence reason
    No explicit confidence assessment is recorded for this claim.
  9. Judge each draft comment
    Statement type
    Fact
    Provenance
    Reported
    Confidence
    Not assessed
    Confidence reason
    No explicit confidence assessment is recorded for this claim.
  10. Post passing comments
    Statement type
    Fact
    Provenance
    Reported
    Confidence
    Not assessed
    Confidence reason
    No explicit confidence assessment is recorded for this claim.
  11. Key observation

    Reviews every pull request

    Duplicate representation of Headline claim. Restates the every-pull-request coverage component of the compound headline; same passage, scope, and period.

    Statement type
    Metric
    Provenance
    Reported
    Confidence
    Medium
    Confidence reason
    HubSpot reported the figures in its own engineering blog.
    Reported by
    HubSpot
    Scope
    Pull-request coverage after the six-month rollout
    Denominator
    HubSpot pull requests
    Method
    Not reported
    Observation date
    Not reported
  12. Key observation

    Engineer feedback time cut by 90%

    Duplicate representation of Headline claim. Restates the 90 percent feedback-time component of the compound headline; same passage and metric scope.

    Statement type
    Metric
    Provenance
    Reported
    Confidence
    Medium
    Confidence reason
    HubSpot reported the figures in its own engineering blog.
    Reported by
    HubSpot
    Scope
    Time for engineers to receive code feedback from Sidekick; not overall PR completion time
    Denominator
    Not reported
    Method
    Not reported
    Observation date
    Not reported
  13. Key observation
    Statement type
    Metric
    Provenance
    Reported
    Confidence
    Medium
    Confidence reason
    HubSpot reported the figures in its own engineering blog.
    Reported by
    HubSpot
    Scope
    Developer emoji reactions on review comments during the preceding couple of months
    Denominator
    Thumbs-up and thumbs-down reactions; not all developers or all reviews
    Method
    Emoji reactions and replies on review comments
    Observation date
    Not reported
  14. Lesson
    Statement type
    Opinion
    Provenance
    Reported
    Confidence
    Medium
    Confidence reason
    HubSpot attributed the improvement chiefly to the judge gate in its own engineering blog; no independent evaluation exists.
  15. Operating model assessment
    Statement type
    Inference
    Provenance
    Catalog judgment
    Confidence
    Medium
    Confidence reason
    The engineering blog describes engineers acting on Sidekick review comments, which locates human attention at work-product review.
    Observation date
    2026-03