The last post of this series focused on setting up a pool of compute nodes on Azure Batch. In this part I show how to add jobs to a pool and then how to add tasks to a job. To summarize the nomenclature: a task is, in the context of CFD, a simulation, a job is a set of simulations. It is possible to configure jobs directly from the portal by selecting Jobs in the side bar, and clicking on the “+Add” button: This will open the “Add job” screen: where we have to select: The job id, following the rules indicated in the figure The pool (click and select…
-
-
CFD simulations on Azure Batch – Part 4
Part 3 of this series focused on creating a file share in Azure Storage to be used with Azure Batch. In this part, I will show how to setup a pool of compute node. This can be achieved using both the Azure Portal and the C# or Python API. I will show how to do so using the portal in general, since it may be useful to be familiar with the portal for simple use cases. Then I will provide a summary of the key instructions of the C# API to achieve the same tasks with a few lines of code, and a brief description of how to use the…
-
CFD simulations on Azure Batch – Part 2
In the first part of this series of blog posts, I showed how to configure an OpenFOAM® case to be executed automatically through a bash script. The script allows the case to be restarted at need, without repeating steps of the case setup that were executed the first time it was executed. Before proceeding with the configuration of Azure Batch, I recommend the installation of two tools provided by Azure: Azure Storage Explorer Batch Explorer Both tools are available for Windows®, Linux® and mac®, so their use is not restricting to a specific operating system. I also recommend installing an SSH client: all the main operating systems currently provide one,…
-
CFD simulations on Azure Batch – Part 1
I have recently used Azure Batch to do CFD simulations using OpenFOAM®, and I summarize my experience and the procedure I followed below. Before entering the details, it is worth saying what Azure Batch is. Azure Batch is a compute management service that lets users to rapidly deploy batch processes either by running multiple tasks on individual nodes, or a single task on multiple nodes, with high-performance communication (Infiniband or, as it is called in the service, RDMA). While Azure Batch is not a full replacement for an HPC cluster with standard queue systems, it is a convenient option for projects that require a defined number of simulations that need…