Leveraging Microservices & Kafka to Scale Developer Productivity

Tuesday  12 February  2019  4:00 PM    Wednesday  13 February  2019 4:30 AM
Save (3) Saved (4)
Last update 14/02/2019

Join us for an Apache Kafka meetup on February 12th from 6:00pm, hosted by Yugabyte. The address, agenda and speaker information can be found below. See you there!


6:00pm: Doors open
6:00pm - 6:30pm: Networking, Pizza and Drinks
6:30pm - 7:15pm: Mohinish Shaikh, Confluent
7:15pm - 8:00pm: Yugabyte talk, TBC
8:00pm - 8:30pm: Additional Q&A and Networking


Talk 1:

Mohinish Shaikh

Mohinish is an engineer in the developer productivity team at Confluent and works on release, packaging, deployment, test & infrastructure automation. Mohinish’s area of expertise includes architecting & developing IAAS, container native cloud infrastructures, automated cloud agonistic infrastructure for microservices, chaos engineering, frameworks for orchestration engines, CI/CD, datacenter automation, test automation, monitoring, observability, provisioning & image management.

Before joining Confluent, Mohinish worked on architecting & developing container native & cloud agonistic infrastructure platform that enabled 5000 containers to run on a bare metal production environment across 5 datacenters (including china).

Leveraging Microservices & Kafka to Scale Developer Productivity

Developer productivity is a discipline that has increasingly becoming critical for companies and organizations to deliver software reliably, on time and with reasonable cost. The scope of this discipline can touch anything & and everything from commit to production and strives to provide a common infrastructure to ship code to production.

Microservices is an approach to application development in which a large application is built as a collection of modular, isolated components or services. Organizations are increasingly adopting microservices architecture to shorten time to market of a software product as it helps optimizing teams to be more productive by implementing automation throughout the life-cycle of a product.

Leveraging microservices architecture for the management and automation of developer productivity pipelines helps enhance organization's productivity at scale. In this talk, I will share my experiences leveraging microservices and kafka to build automated end-to-end self serviceable productivity pipelines that enable build, test, deployment, release, packaging, orchestration, provisioning, observability and chaos engineering systems.

In this context, Kafka helps with aggregation of valuable insights on these independent services as they collaborate with each other in real-time, which is then leveraged to learn and enhance the infrastructure platform.

Developer productivity systems uses Kafka as a enterprise message bus to pass context, data and configuration to trigger complex interplay among various tools, services, infrastructure and environments as code propagates from a developer’s machine to production. In addition, data is harvested from monitoring, tracing, observability frameworks to be routed through Kafka to generate real time state of the propagation using streaming analytics to paint a correlation between various phases of software lifecycle. This real time data is also fed into learning systems using AI/ ML to learn about code propagation lifecycle, failures across services and resource utilization of the clusters across various environments.

Talk 2:

Speaker: Yugabyte Speaker and talk (TBC)

Bio: (TBC)

Title: (TBC)

Abstract: (TBC)


Don't forget to join our Community Slack Team! https://launchpass.com/confluentcommunity

If you would like to speak or host our next event please let us know! [masked]

culture food collecting streaming painting
Nearby hotels and apartments
YugaByte Inc
771 Vaqueros Ave, Sunnyvale, 94085, CA, US
YugaByte Inc
771 Vaqueros Ave, Sunnyvale, 94085, CA, US