Skip to main content

Blog posts tagged
"Big Data"

Rob Gibbon
16 November 2022

Apache Kafka service design for low latency and no data loss

Apps Article

Designing a production service environment around Apache Kafka that delivers low latency and zero-data loss at scale is non-trivial. Indeed, it’s the holy grail of messaging systems. In this blog post, I’ll outline some of the fundamental service design considerations that you’ll need to take into account in order to get your service arch ...

Rob Gibbon
31 August 2022

Kubernetes operators – the top 5 things to watch for

Charms Article

Software operators are steadily revolutionising how we deploy and run complex distributed systems. They offer the promise of low-intervention, self-driving software – ideally leading to service reliability gains and better uptime. For an introduction to Kubernetes operators, check out our introductory webinar or download our guide to Kube ...

Rob Gibbon
6 December 2021

Canonical Data Platform 2021 winter roundup

AI Article

Canonical Data Platform: that was 2021 It’s that time of the year again: many folks are panic buying cans of windscreen de-icer spray and thermal underwear, bringing pine trees into the front room and preparing to enjoy an extended break with the family. So we thought to ourselves, what better time than now to take ...

Rob Gibbon
10 November 2021

SQL Server on Ubuntu Pro: bringing it all back home

Cloud and server Article

Not going to lie, the Microsoft SQL Server is my all-time favourite Microsoft product. For a long time, SQL Server was only available for Windows, but not much is really sacred. So now Microsoft, in collaboration with Canonical, are distributing and supporting several flavours of SQL Server on Ubuntu Pro for Azure. I’m going to ...

Rob Gibbon
26 October 2021

In defence of pet servers

Apps Article

We all know the drill by now: modern compute infrastructure needs to be deterministic, disposable, commoditised and repeatable. We’re all farmers now, and our server estates must be treated like cattle – ready for slaughter at a moment’s notice. However, we must remember that the driver behind the new design rationale is primarily the unr ...

Rob Gibbon
30 August 2021

Cloud PaaS through the lens of open source – opinion

Data Systems Article

Opinion piece by Rob Gibbon – Product Manager at Canonical. All views expressed are the author’s own. The open source perspective viz. PaaS Open source software, as the name suggests, is developed in the open. The software can be freely inspected by anyone, and can be freely patched as required to suit the security requirements ...

Rob Gibbon
18 August 2021

How to run Apache Spark on MicroK8s and Ubuntu Core, in the cloud: Part 4

Cloud and server Article

In this series, we’ve been building up an Apache Spark cluster on Kubernetes using MicroK8s, Ubuntu Core OS, LXD and GCP. We’ve learned about and set up nested virtualisation on the cloud, and had some fun. But right, it’s retrospective time: in Part 1, we saw how to get MicroK8s up on LXD, on Ubuntu ...

Rob Gibbon
18 August 2021

How to run Apache Spark on MicroK8s and Ubuntu Core, in the cloud: Part 3

Cloud and server Kubernetes

If you’ve followed the steps in Part 1 and Part 2 of this series, you’ll have a working MicroK8s on the next-gen Ubuntu Core OS deployed, up, and running on the cloud with nested virtualisation using LXD. If so, you can exit any SSH session to your Ubuntu Core in the sky and return to ...

Rob Gibbon
18 August 2021

How to run Apache Spark on MicroK8s and Ubuntu Core, in the cloud: Part 2

Cloud and server Article

If you have followed Part 1 of this blog post, you’ll have a working setup that allows you to run MicroK8s on Ubuntu Core in a VM on your local workstation using Multipass. But you’re itching to get this up and running on the cloud. I know, so am I! So let’s step through that ...

Rob Gibbon
18 August 2021

How to run Apache Spark on MicroK8s and Ubuntu Core, in the cloud: Part 1

Cloud and server Article

There are some great reasons to use nested virtualisation on compute clouds. Nested virtualisation is when you have Virtual Machines running within Virtual Machines. This approach offers a stronger isolation model than containers: by using a dedicated kernel and IO devices, bad behaviour cannot easily break out and spread. In fact, nested ...

Rob Gibbon
28 May 2021

Let’s play: sharded big data PostgreSQL

Data Systems Article

Everyone knows that if you’ve got big data, you need Apache Hadoop, right? It’s an affordable, horizontally scalable, clustered data processing platform ideal for data warehousing use cases. And it knocks the socks off classic relational database management systems like PostgreSQL that can barely keep up when playing with a terabyte of da ...

  1. Previous page
  2. 1
  3. 2
  4. 3
  5. Next page