Eclipse Otterdog

Introduction

Otterdog is a tool to manage GitHub organizations at scale using a configuration as code approach. It is actively developed by the Eclipse Foundation and used to manage its numerous projects hosted on GitHub.

Quickstart

To install and use the cli part of otterdog you have to install the following:

• git (mandatory): install using apt install git
• otterdog (mandatory): install using pipx install otterdog
• bitwarden cli tool (optional): install using snap install bw
• pass cli tool (optional): install using apt install pass

Otterdog Presentation @ Open Source Summit 2023

Default Configuration used @ Eclipse Foundation

Documentation

The documentation is available at otterdog.readthedocs.io.

Build instructions

System requirements:

• python3.11+ (mandatory): e.g. install using apt install python3 or use pyenv install 3.12
• git (mandatory): install using apt install git
• poetry (mandatory): install using pipx install poetry
• dynamic versioning plugin (mandatory): install using pipx inject poetry "poetry-dynamic-versioning[plugin]"
• bitwarden cli tool (optional): install using snap install bw
• pass cli tool (optional): install using apt install pass

Building Steps

• Create a virtual python environment and install necessary python dependencies using poetry:

$ make init

Running make init will also install poetry and the dynamic versioning plugin if it is not installed yet.

• Testing build

$ ./otterdog.sh -h

Quick Setup

To start using the cli part of otterdog right away on a specific organization you have to set up the following:

• define a default configuration to use, you can use the following default config as a starting point
• create a otterdog.json file that contains the list of organizations you want to manage and some customizations
• start managing your organizations using the cli

Default configuration

You can define your own default configuration or use the following base template right away: https://github.com/eclipse-csi/otterdog#examples/template/otterdog-defaults.libsonnet@main.

Otterdog configuration

Create a otterdog.json file with the following content (replace bracketed values according to your setup):

{
  "defaults": {
    "jsonnet": {
      "base_template": "https://github.com/eclipse-csi/otterdog#examples/template/otterdog-defaults.libsonnet@main",
      "config_dir": "orgs"
    },
    "github": {
      "config_repo": ".otterdog"
    }
  },
  "organizations": [
    {
      "name": "",
      "github_id": "",
      "credentials": {
        "provider": "bitwarden",
        "item_id": ""
      }
    }
  ]
}

The name of the configuration file can be freely chosen (can be specified with the -c flag). However, when named otterdog.json, the cli tool will automatically detect and use that file if it is in the current working directory.

Credentials

Otterdog needs certain credentials to access information from an organization and its repositories on GitHub:

• username / password / 2FA seed
• API token

The login / username / 2FA seed are required to access the web interface of GitHub in order to retrieve certain settings that are not accessible via its rest / graphql API.

The GitHub api token needs to have the following scopes enabled:

• repo
• workflow
• admin:org
• admin:org_hook
• delete_repo

The credentials can be stored in different providers (bitwarden, pass).

Bitwarden

When using bitwarden to store the credentials, you need to enter a valid item id as additional credential data:

{
  "organizations": [
    {
      "name": "",
      "github_id": "",
      "credentials": {
        "provider": "bitwarden",
        "item_id" : ""
      }
    }
  ]
}

The item stored in bitwarden needs to contain the following information (a sample json output of such an item):

{
  "object": "item",
  "id": "",
  "name": "",
  "fields": [
    {
      "name": "api_token_admin",
      "value": ""
    }
  ],
  "login": {
    "username": "",
    "password": "",
    "totp": ""
  }
}

Mandatory items:

• Field with name "api_token_admin" and as value the GitHub token to access the organization
• login.username of a user that can access the organization with enabled 2FA
• login.password the password of that user
• login.totp the TOTP text code

Pass

When using pass to store the credentials, you need to enter fully qualified pass names to access the various required credential data:

{
  "organizations": [
    {
      "name": "",
      "github_id": "",
      "credentials": {
        "provider": "pass",
        "api_token": "