Skip to content

Aglais progress meeting 1st Feb 2021

Jump to bottom
Zarquan edited this page Feb 1, 2021 · 13 revisions

Presentations and Q/A session about the technologies we have chosen and how the implementation is progressing.

  • Date/time: 1st Feb 2021 13:00-14:00
  • Location: Zoom meeting
    • Meeting ID: 649 471 0998
    • Passcode: 597554

The meeting is intended as an informal workshop, with a mixture of talks and time for questions and discussion. The schedule is a rough guide to try to fit all the talks into an hour. Timings will vary on the day, some parts will take longer, some parts will be shorter. We can have some quick questions after each talk, and then a longer Q/A session after the main meeting if people are interested.

13:00 - Deployment technologies - Dave Morris

  • Job schedulers - Hadoop/Yarn, Kubernetes
  • Deployment tools - Openstack, Ansible, Magnum, Helm, Terraform
  • Create and delete scripts
  • Slides (PDF)

13:10 Kubernetes on IRIS/Openstack - Gareth Francis

  • Openstack at RAL and Somerville
  • Deploying Kubernetes with Rancher

13:20 Storage technologies - Dave Morris

  • Hadoop HDFS on Openstack Cinder
  • Amazon S3 with Openstack Swift
  • CephFS with Openstack Manila
  • Slides (PDF)

13:30 Rubin Observatory science platform - Stelios Voutsinas

  • Comparison between RSP and Aglais

13:40 Dask for Lasair - Roy Williams

  • Experiments with Dask

13:50 Science uses cases - Nigel Hambly

  • Simple sky map example(s)
  • PySpark SQL UDF example
  • Machine learning workflow

14:00 Aglais team available for Q/A and discussion ..

Clone this wiki locally