Launch: Workflow Analytics

Jun 18, 2024

Aayush Shah

We’re thrilled to share the first iteration of Blacksmith’s workflow analytics offering! Blacksmith now provides a rich breakdown of usage data across workflows and repositories.

An overview of an organization’s test and build pipelines is table-stakes for any CI provider. We heard from numerous GitHub Action users about how the lack of observability into their CI made maintaining it very challenging, especially as a company scaled to tens of repositories and hundreds of workflows. More committed customers would end up writing scripts powered by the GitHub API, but this meant maintaining yet another piece of home-grown test infrastructure.

Our new dashboard focuses on three important aspects of your CI pipeline - performance, spend and failure rate. This data equips our users to be able to quickly identify the longest running and most expensive parts of their CI, or the day when a change affected the health of their CI pipeline. By sorting and filtering the data on a per workflow or repository basis, our users can focus on what is important to them.

This is just the start. We are doubling down on surfacing actionable data through this dashboard. Some things to look out for over the next few weeks are:

  • more granular information about the jobs that constitute a workflow

  • visualizations to better understand variance in workflow run times

  • easier detection of flaky jobs in a workflow

Now is a good time to stop clicking through the GitHub Actions UI to get basic information about your workflows! We love hearing about what our users want from their CI so reach out to us at hello@blacksmith.sh.