1. Post-processing and visualization

    MET post-processing and visualization systems are primarily used for small and large scale serial- and parallel processing tasks. In order to post- or reprocess modeldata or to visualize 2D/3D data remotely, MET relies on state-of-the are technology.

    To achieve the maximum throughput and to handle the huge amounts of parallel I/O operations Researcher and Meteorologists at MET benefit of low latency and high bandwidth networks and highly parallel storage systems We ensure data integrity by checksumming network traffic and on disk data.

    To enable remote sites and airports to access (weather) data on demand and independent from your location we are providing a remote 2D/3D visualization service.


  2. Production OpenStack


    The requirement of this OpenStack setup is to have a highly available cloud spread over two or more data centers. It will replace the current solution where a user is requesting a VM from the infrastructure group, which is ineffective and time consuming.

    The aim of the setup is to be able to lose one data center, without affecting production. The use of containers makes it easier to scale the services by adding more servers, and to set up an identical staging environment to test upgrades or develop new services.

    It was also a good opportunity to introduce new technology and when you setup an OpenStack service as a container from scratch, you get pretty familiar with the service.

    We are not using docker overlay network at the moment, but it would be nice to have it in the future, so we don't have to expose too many ...


  3. Security clearance

    Security clearance

    As part of the public administration, some MET positions require a security clearance. Please read more about clarence at NSM Web pages, especially the frequently asked questions page - Google translated for your convenience.

    Short summary:

    1. Norwegian citizens are eligible for a deterministic security clearance process
    2. Citizens of countries Norway has personnel security collaboration with (NATO countries, Schengen countries, countries Norway extends a great deal of trust to) are eligible for a deterministic security clearance process
    3. Citizens of countries Norway does not have a personnel security collaboration agreement with might never obtain a Norwegian security clearance, or the clarence process may take years to conclude
    4. If investigations of your person record evaluated to not comply with clearance requirements you may be denied clarence regardless of your citizenship

    If you belong to category 3 or 4, and the position require security clearance, we will discourage you from applying for the ...


  4. MET Norway open Clos Data Center Network

    Open Clos Data Center Network

    In 2015, MET Norway needed to replace an old core switch based network. Instead of replacing it, we defined the network as legacy infrastructure, and we invested in an open Clos leaf/spine network to be ready for SDN in connection to the OpenStack based production MET Cloud.

    MET Norway purchased 14 Juniper QFX5100-24Q 40Gbit switches with aggregate backbone capacity of 1.2Tbits. The new data center network is pure layer 3, L2 does not extend outside each leaf switch.


    EBGP is used between all leafs and spines. EBGP is also used between the border leafs and GWs. BGP peers are configured to only accept specific routes, they will also only send specified routes.


    We're using OSPF between leafs and zone switches (see illustration). This is redistributed into bgp in order to connected the openstack network with the rest of the cloud ...


  5. Google Web App using Spreadsheet

    Best of both worlds (Spreadsheet and dynamic Web interface)

    Managing information is a challenge. Often times you end up pasting information into a Spreadsheet, you try to make a system out of the madness.. Google comes along offering you an online (Google) Spreadsheet - so you can share your Spreadsheet with colleges! Your co-workers can help you out, thats nice, but you risk ending up with a mess! Just maybe you are better off limiting access to messing up the somewhat valuable Google Spreadsheet data to a smaller group of colleges, while less involved colleagues collaborate via a simple Web based user interface? As Google Spreadsheets are Web based by nature, attaching a Web interface is not far away. This is how you do it:

    Create a Google Spreadsheet

    This one you will have to figure out yourself :) (drive.google.com -> "New" -> "Sheets")

    Name the spreadsheet (replace "Untitled project" with a ...


  6. OpenStack Ceilometer basics

    The Ceilometer

    Ceilometer - OpenStack Telemetry

    OpenStack uses Ceilometer to measure Cloud usage.

    Telemetry is nice, as infrastructure utilization gets visible to users, developers, project leaders, management and to the IT department for utilization and budgetary purposes.

    Telemetry for OpenStack

    Getting telemetry from OpenStack quickly changed from optimism to frustration. OpenStack has all of these really nice APIs you can use to query all kinds of information, but there is no mature project for setting it in a system - and we really do not want to start writing a Cloud accounting system from scratch.

    Simple start - the API

    How to utilize the API could be better documented. Let's walk through the basics.

    First you need to get a token:

    . openrc    # openrc sets a number of useful variables
    echo $OS_AUTH_URL

    Get and store the adminURL in the ADMIN_URL variable (using quick and dirty method):

    ADMIN_URL=`curl -s -X ...


  7. How to Configure Knife and Test Kitchen to use OpenStack

    Originally published on arnesund.com

    When developing Chef cookbooks, Knife and Test Kitchen (hereafter just "Kitchen") are essential tools in the workflow. Both tools can be set up to use OpenStack to make it easy to create VMs for testing regardless of the capabilities of the workstation used. It's great for testing some new recipe in a cookbook or making sure changes do not break existing cookbook functionality. This post will go through the configuration of both tools to ensure they use OpenStack instead of the default Vagrant drivers.

    Install software and dependencies

    First, it is necessary to install the software, plugins and dependencies. Let's start with some basic packages:

    sudo apt-get install ruby1.9 git
    sudo apt-get install make autoconf gcc g++ zlib1g-dev bundler

    Chef Development Kit

    The Chef Development Kit is a collection of very useful tools for any cookbook developer. It includes tools like Knife ...


  8. Kodeklubben

    Her finner du presentasjoner og kodeeksempler fra Kodeklubben sitt besøk på Meteorologisk institutt (MET) 18. februar 2015. Vi demonstrerer bruk av http://api.met.no og kart-tjenestene til MET for bruk i egne kodeprosjekt.

    IPython Notebook

    Du må ha IPython Notebook installert for å kunne jobbe videre på Notebook-en vi laget på tirsdag. Se "Install" på http://ipython.org for informasjon om hvordan IPython Notebook kan installeres på forskjellige plattformer.

    Presentasjoner og kodeeksempler

    Her finner du alle presentasjoner og kodeeksempler vi gikk igjennom:

    1. Presentasjon av MET
    2. IPython Notebook-en med blant annet eksempler på bruk av http://api.met.no
    3. Presentasjon og kodeeksempler på bruk av kart-tjenestene til MET


  9. How to Use Cloud-init to Customize New OpenStack VMs

    Originally published on arnesund.com

    When creating a new instance (VM) on OpenStack with one of the standard Ubuntu Cloud images, the next step is typically to install packages and configure applications. Instead of doing that manually every time, OpenStack enables automatic setup of new instances using Cloud-init. Cloud-init runs on first boot of every new instance and initializes it according to a provided script or config file. The functionality is part of the Ubuntu image and works the same way regardless of the cloud provider used (Amazon, RackSpace, private OpenStack cloud). Cloud-init is also available for other distributions as well.

    Creating a customization script

    Standard Bash script

    Perhaps the easiest way to get started is to create a standard Bash script that Cloud-init runs on first boot. Here is a simple example to get Apache2 up and running:

    cat > cloudinit.sh <<EOF
    > #!/bin/bash
    > apt-get update
    > apt-get -y install ...


  10. Remove unused kernels

    Removes all but current kernel and headers for freeing up disk space. This is a note for internal use and tested for Ubuntu Precise. Use at your own risk :)

    dpkg-query -f '${Package}\n' -W |  egrep 'linux-(headers|image)-[[:digit:]].*(|-generic)' | grep -v $(uname -r | sed 's/-generic//') | sudo xargs apt-get -q -q -yy --purge remove


    1. List all packages.
    2. Find only linux-image and linux-header packages with version number, not the two main meta packages.
    3. Remove the linux-image and linux-header for running kernel from the list.
    4. Purge all listed packages from system without asking any questions.
    vim: set syn=markdown spell spl=en:


Page 1 / 2 »