Protocol Buffers/gRPC Artifact Pipeline
Ibotta uses gRPC and Protocol Buffers to rapidly innovate in a microservice-driven environment. gRPC provides low-latency, bi-directional binary streaming via HTTP/2. gRPC also relies on reusable, validateable, language-agnostic Protocol Buffers messages.
Because of these advantages, many of our services are using gRPC for their inter-service communication. We’re also using Protocol Buffers outside of gRPC for predictable serialization/deserialization of messages on streams and queues.
However, our initial implementation for packaging Protocol Buffers messages and gRPC services could not handle the influx of new technologist (engineers, data scientists and analysts) interest. I wrote an article on Medium describing how I built a scaleable pipeline to rapidly ship Protocol Buffers & gRPC artifacts to production.
- Scaleable Developer Tooling
- Build and Deployment
- Protocol Buffers
- Artifact Delivery
For detailed information, check out the article article on Medium.