In this blog, I am going to talk about running a timeseries and analytics database kdb+ workload on PowerFlex. In my previous post, I have explained in detail about kdb+ , which is commonly used in high-frequency trading for data and analytics storage. First, lets talk about the lab configuration. I have set up PowerFlex... Continue Reading →
Installation of time series database kdb+ and KDB.AI on Ubuntu
Today, I am going to talk about a powerful timeseries database kdb+ and a vector database KDB.AI. In the current era of digitization, massive amount of data is getting generated by humans and machines. When we have tons of data, getting insight from it is becoming more and more challenging. Databases like TSDB (Time Series... Continue Reading →
CockroachDB deployment on PowerFlex
This blog talks about an interesting database ‘CockroachDB’ and its deployment along with performance tests on Dell PowerFlex which is a Software Defined Storage. A bit of history, Cockroach Labs was founded in 2015 by ex-Google employees. CockroachDB is an open-source database by Cockroach Labs, inspired by Google distributed database projects Spanner and F1. CockroachDB is... Continue Reading →
Running MLPerf Storage benchmark on a VM
This post tells you how to deploy and run MLPerf storage benchmark on an Ubuntu VM. Ideally, these tests should run on a powerful storage systems like Dell PowerFlex. However, my aim here is to just write down instructions to run MLPerf on BareMetal/VM. Let's first understand the benchmark. MLPerf benchmark attempts to balance two... Continue Reading →
Deployment of OpenShift 4.12 using Assisted Installer
In this post, I am going to write down the instructions for deployment of OpenShift 4.12 using Assisted Installer. With this approach, OpenShift can be deployed quickly and for Engineers like me can focus on tasks post OCP deployment like building solutions, performance benchmarking rather than debug & fix OCP deployment issues. So let's begin... Continue Reading →
Protecting MongoDB using PowerFlex replication
Data is often one of the most valuable assets to an organization. It is being accessed constantly by the various applications, users, and sometimes directly by customers of the organization. Data Protection is more than just backing up data. In this blog, I am going to talk about Dell PowerFlex provides asynchronous replication which allows... Continue Reading →
Using RESNET50 model with AL/ML workloads on PowerFlex
In this post, I am going to talk about an interesting topic of running TensorFlow on nvidia resnet50 containers. My earlier post explains the integration of NVIDIA A100 GPU’s on PowerFlex. I have used the same architecture to carry out few lab tests. So after the installation of the nvidia drivers on the VM’s ,... Continue Reading →
CPU v/s vGPU on RESNET50 container
In the previous post, I have shown you how to integrate NVIDIA A100 GPU with PowerFlex. This post, shows you quick difference between CPU vs GPU in terms of performance using the RESNET50 inference benchmark. After the NVIDIA vGPU drivers get installed, its time now to install the NVIDIA container toolkit. For an Ubuntu VM... Continue Reading →
How I built an AI platform (Riva Speech Services) with RedHat OpenShift, NVIDIA GPU’s, and PowerFlex
In the recent past, I’ve been working on AI/ML with PowerFlex as SDS. My objective was to build a cloud-native artificial intelligence platform made up of Red Hat OpenShift cluster, NVIDIA GPU’s and PowerFlex. So initially, I built PowerFlex 4.0 platform of 4 SDS. On separate PowerEdge nodes, I built an OpenShift BareMetal cluster... Continue Reading →
Integration of NVIDIA A100 GPU with PowerFlex 4.0
In this post, I would be explaining how NVIDIA GPU (A100) integrates with PowerFlex 4.0 and then in the subsequent post I would be talking about Performance Benchmarking with ResNet50 inference & training models for TensorFlow on PowerFlex. Initially, I configured the PowerFlex 4.0.0 cluster with 4 CO nodes (ESXi 7.0.3) and 4 SO nodes... Continue Reading →