Application Integration Using Queues and Messages

In previous blog posts in this messaging series, we provided an overview of messaging and we also explained the common characteristics to consider when  evaluating messaging channel technologies. In this post, we will explain some of the semantics of queue-based processing, its use in designing flexible systems, and how to Read more…

An AWS Bill Analysis: Changelogs.md

Nathan Peck, AWS Senior Developer Advocate and friend to all, runs the surprisingly handy changelogs.md service that gathers changes to a wide variety of packages. He’s been remarkably transparent with changes he’s made to make running it more cost-efficient—and since he’s running this in a personal account, this is real Read more…

Introducing Cloud AI Platform PipelinesIntroducing Cloud AI Platform PipelinesProduct Manager, TFXStaff Developer Advocate

When you’re just prototyping a machine learning (ML) model in a notebook, it can seem fairly straightforward. But when you need to start paying attention to the other pieces required to make a ML workflow sustainable and scalable, things become more complex. A machine learning workflow can involve many steps Read more…

Event-Based Processing for Asynchronous Communication

In the first post in this series on messaging patterns, we gave an overview of messaging and the benefits and challenges of both synchronous and asynchronous service communication. In this post, we will look at common characteristics to consider when evaluating messaging channel technologies. We will also introduce Amazon EventBridge, Read more…

Create deployment pipelines for your GKE workloads in a few clicksCreate deployment pipelines for your GKE workloads in a few clicksProduct Manager

With Kubernetes becoming the de facto standard for container orchestration, many development teams are looking to build, test, and deploy code quickly in a frictionless manner to Kubernetes. Traditional continuous integration and continuous delivery (CI/CD) tools not designed for cloud-native environments often fall short as developers spend many hours looking Read more…

Testing and creating CI/CD pipelines for AWS Step Functions

AWS Step Functions allow users to easily create workflows that are highly available, serverless, and intuitive. Step Functions natively integrate with a variety of AWS services including, but not limited to, AWS Lambda, AWS Batch, AWS Fargate, and Amazon SageMaker. It offers the ability to natively add error handling, retry Read more…

With Kubeflow 1.0, run ML workflows on Anthos across environmentsWith Kubeflow 1.0, run ML workflows on Anthos across environmentsSoftware EngineerEngineering Manager

Google started the open-source Kubeflow Project with the goal of making Kubernetes the best way to run machine learning (ML) workloads in production. Today, Kubeflow 1.0 was released.  Kubeflow helps companies standardize on a common infrastructure across software development and machine learning, leveraging open-source data science and cloud-native ecosystems for Read more…