How do you make a data team successful?
There's no easy answer.
We started as a data team ourselves, on a quest to make ourselves as agile as we could. We borrowed the principles of Agile from product teams, DevOps from engineering teams, and Lean Manufacturing from supply chain teams.
The DataOps Culture Code
🤝 It’s a team sport, and collaboration is key
Data teams will always have a variety of roles, each with their own skills, favorite tools and DNA. Embrace the diversity, and create mechanisms for effective collaboration.
🗄 Treat data, code, models and dashboards as assets.
All data assets — from code and models to data and dashboards — are assets, and they should be treated like assets.
- Assets should be easily discoverable.
- Assets should be maintained.
- Assets should be easily reusable.
🚀 Optimize for agility
- Reduce dependencies between business, analysts and engineers.
- Enable a documentation-first culture.
- Automate whatever is repetitive.
👥 Create systems of trust
With the inherent diversity of data teams, it's all too easy to misunderstand other team members' roles. But that creates trust deficiencies — especially when things go wrong!
Intentionally create systems of trust in your team.
- Make everyone’s work accessible and discoverable to break down "tool" silos.
- Create transparency in data pipelines and lineage so everyone can see and troubleshoot issues.
- Set up monitoring and alerting systems to proactively know when things break.
🖇️ Create a plug-and-play data stack
The data ecosystem will rapidly evolve. The tools, technology and infrastructure you use today will (and should) be different from the tools you use two years later.
Your data stack should allow your team to experiment and innovate as technology evolves, without creating lock-ins.
- Embrace tools that are open and extensible.
- Leverage a strong metadata layer to tie diverse tooling together.
✨ User experience defines adoption velocity
Employees at Airbnb famously said, "Designing the interface and user experience of a data tool should not be an afterthought."
Without good user experience, the best tools or most thoughtful processes won't be adopted in your team.
Invest in user experience, even for internal tools. It will define adoption velocity!
- Invest in simple and intuitive tools.
- Software shouldn't need training programs.