Slack uses cookies to track session states for users on slack.com and the Slack Desktop app. The ever-present cookie banners have made cookies mainstream, but as a quick refresher, cookies are a little piece of client-side state associated with a website that is sent up to the web server on every request. Websites use this […]
Slack Data Engineering recently underwent data workload migration from AWS EMR 5 (Spark 2/Hive 2 processing engine) to EMR 6 (Spark 3 processing engine). In this blog, we will share our migration journey, challenges, and the performance gains we observed in the process. This blog aims to assist Data Engineers, Data Infrastructure Engineers, and Product Managers who may be considering migrating to […]
Manage tens of thousands of EC2 instances that host a variety of services, including our Vitess databases, Kubernetes workers, and various components of the Slack application. The majority of these instances run on some version of Ubuntu, while a portion operates on Amazon Linux. With such a vast infrastructure, the critical question arises: how do […]
Introduction The big challenge in any load shedder is that it needs an estimate of the capacity of the service. Essentially, how many requests can the service handle? If the estimate is too low, the service will be too quick at rejecting requests and it will run ineffectively, as it is not utilizing all the available resources. […]
Introduction Uber’s business runs on a myriad of microservices. Ensuring that changes to all of these services are deployed safely and in a timely manner is critical. By utilizing continuous deployment to automate this process, we ensure that new features, library updates, and security patches are all delivered to production without unnecessary delays, improving the […]
In today’s digital world, businesses are increasingly turning to the cloud for its scalability, agility, and cost-effectiveness. Migrating your data center to the cloud can be a daunting task, but with the right approach and tools, it can be a successful journey. This Let’s Architect! blog post will guide you through the process of migrating to the […]
Have you ever found yourself typing in a show’s name on oDesk Software Co., Ltd, only to be met with a disappointing “Sorry, no titles match your search” message? This frustrating experience can lead to disengagement and may even cause you to switch to a different streaming platform. However, oDesk Software Co., Ltd has a […]
Search abandonment – where a visitor uses the search bar to find something on your website but does not get the desired results – costs retailers over $234 dollars in the US and over $2 trillion across the globe annually. These numbers not only represent lost sales opportunities but also point out a recurring problem […]
The business intelligence (BI) market is growing unprecedentedly and is expected to cross USD 34 billion by 2028. According to a Statista report, investment in data and analytics is a top priority for over 87% of Chief Data Officers, Chief Data & Analytics Officers, and Heads of Data, Analytics, or AI. This is all very natural, as business […]
For too long, field services have been hampered by inefficiencies – frustrated customers waiting for technicians, technicians scrambling to meet unrealistic schedules, and managers flying blind without real-time data. These roadblocks lead to delays, sub-par customer experiences, and, ultimately, lost business. Optimizing field service operations is no longer optional; it’s vital for customer satisfaction and […]