Skip to content
This repository has been archived by the owner on Apr 1, 2023. It is now read-only.

Releases: futurewei-cloud/arion

Arion v0.2.0 release

10 Oct 19:42
48fe463
Compare
Choose a tag to compare
Arion v0.2.0 release Pre-release
Pre-release

Open-Source Plan for v0.2.0 Release

Tentative date: 10/10/2022
Release: Arion v0.2.0
Release link: TBD

Release Summary

  • Background

  • Highlights of features and performance

    • Arion DP
      • Designed and implemented e2e DP notification mechanism which supports transmitting OAM information through Data Plane
      • Achieved near direct CN-CN Redis application benchmark throughput (94+% for small packet size, 96%-110% for larger packet size)
    • Arion CP
      • Designed and implemented state reconciliation between ArionAgent and ArionMaster, to provide data consistency and module robustness
      • Achieved ~40us per neighbor from goal state update received in server to end device programming. Including server db writing and notification latency, server to agent state transmit latency and agent programming latency
    • Arion E2E deployment and test
      • Enabled Arion E2E environment (CN + gateway) deployment and sanity test, please refer to Document

Feature Development

  • Arion DP
  • Arion Master
    • Multi level (group, vpc and goalstate) version management (PR#9)
    • Bug fix of vni in neighbor goal state (PR#6)
  • Arion Agent State Reconciliation (PR#2)
    • Local DB integrated, to provide version control and millions of records for fast local lookup in future (PR)
    • Background DB writer, to not slow-down goal state processing (PR)
    • Concurrent map for multi goal state version control (PR)
    • Retrieve LKG revision for reconciliation (PR)

Performance & Scalability

  • Arion DP
    • Achieved near direct CN-CN Redis application benchmark throughput (94+% for small packet size, 96%-110% for larger packet size)
    • Minimal cost for turning on DP notification at Arion DP (<3% in throughput)
  • Arion CP
    • Achieved ~40us per neighbor from goal state update received in server to end device programming. Including server db writing and notification latency, server to agent state transmit latency and agent programming latency

Fundamental

  • Arion Master
    • Add server benchmarking test tool (PR#10)
  • Arion gateway deployment service
    • Add multi-wings deployment support (PR#2)
    • Fixed virtual IP in-balanced allocation issue for better load balancing (PR#7)
  • E2E test controller
    • Add E2E test ability of Arion modules with CN (PR#749)

Arion Documentation

Arion v0.1.0 release

02 Aug 06:04
9e3741d
Compare
Choose a tag to compare
Arion v0.1.0 release Pre-release
Pre-release

Open-Source Plan for v0.1.0 Release

Tentative date: 8/2/2022
Release: Arion v0.1.0
Release link: TBD

Release Summary

  • Modules and functionalities, Arion as a whole system/topology is made up of 3 major modules and 1 corresponding management/deployment service

    • Arion DP (Data Plane) cluster employing XDP/eBPF program for fast packet forwarding service
    • Arion Master, a regional/cluster level network metadata server
    • Arion Agent, a node level agent for local DP programming
    • Arion DP management service for internal cluster resources and configurations
  • Highlights of E2E performance

    • Arion DP performance
      • Supports over 1 million entries with XDP/eBPF map
      • Achieved close to line-speed XDP packet forwarding
    • Arion CP programming latency
      • Achieved 1 million endpoints E2E programming
      • Achieved latency of small-sized configuration <20us per state (1 < state size < 100)
      • Achieved latency of large-sized configuration <10us per state (100 < state size < 1 million)

Feature Development

  • Arion DP
    • XDP/eBPF based packet processing and L2 forwarding
    • XDP/eBPF program to run in driver mode or generic mode
    • Region-wide neighbor endpoint lookup and forwarding
    • Region-wide tenant ARP responder
    • VxLAN tenant overlay network support
    • DP Integration with ACA (Alcor Control Agent)
  • Arion Master
    • Efficient data schema for fast lookup (PR#1)
    • Unified db wrapper for easy db migration (PR#3)
      • Subscribing/watching to promptly get notified with updates
      • Remotely getting data with low latency
    • Sharded routing goal state to partitioned Arion gateway group for traffic balancing (PR#2)
  • Arion Agent
    • High concurrency network states propagation framework from Arion Master to Arion Wing XDP module
    • Hook with Arion Master for initial state programming and on-going updates

Performance & Scalability

  • Arion DP
    • Supports over one million entries with XDP/eBPF map
    • Reaches near line-speed packet forwarding in a single node with netperf throughput and latency tests
  • Arion Master
    • Single-digit microseconds watch latency per state
    • Average 1 millisecond write latency per state
    • Supports 500k qps for a 100 gateway nodes cluster
  • Arion Agent
    • Achieved 1 million endpoints E2E programming
    • Achieved latency of small-sized configuration <20us per state (1 < state size < 100)
    • Achieved latency of large-sized configuration <10us per state (100 < state size < 1 million)

Fundamental

  • Fully containerized Arion DP build process and integrated unit tests
  • Remote bare-metal Arion DP cluster deployment with physical machines or VMs, templated with lab inventory
  • End-to-End Arion DP cluster setup and test scripts
  • Containerized Arion Master deployment

Arion Documentation