Suborbital-Systems/subo-bizopprodplan
2
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
Files
b3668496773eb4ec181256ea3e465d8ab0b6c59d
subo-bizopprodplan/team-sweng/SwEngTooling.md
Charles N Wyble 12261e3fa5 cleanup
2024-12-26 16:33:50 -05:00

8.0 KiB
Raw Blame History

TSYS Group Handbook - Engineering Documentation - Team SwEng - Tooling

Introduction

This article covers the tools and support stack/systems used by the software engineering team at Suborbital Systems. It should be read by everyone in the engineering organization.

Sw Engineering Systems

  • Build/dev/test systems

    • buildbox (All compiles happen here (either directly or via jenkins invoking)
    • subodev / suboqa (All dev/testing is done on these systems, in particular for hardware engineering test suite iteration etc)

  • Production systems

    • suboprod (All production workloads, validations, simulations run here, cuda enabled for speed. May use docker in future to allow easy sharing of cuda card and versioning workloads)
    • suboprod01-05 (cuda tk1 cluster)
    • opc01/02 (op center systems)

General Information

  • All systems have NTP sync time, and working DNS
  • All systems have an MOTD covering the basics and pointers to detailed documentation
  • All systems have /subo mounted via NFS

/subo directory

localuser@buildbox:~$ ls /subo/
SupplyChain Tooling 
localuser@buildbox:~$

  • SupplyChain is for upstream software that is used in deliverables produced by engineering. It would also contain any libraries/custom software etc that engineering produces

  • Tooling is for off the shelf , upstream, vendor software that is used to support engineering operations. Things like (cross) compilers, custom builds of software etc go in it.

Each directory has the same top-level layout:

SupplyChain:
bin  lib  scripts  src

Tooling:
bin  lib  scripts  src
  • bin is for installed packages (either stand alone (go/java) executables , or compiled software distributions) (with sub directories off of bin for each package, even if it's a single executable (we like clean systems and toolboxes))
root@buildbox:/subo/Tooling/bin# ls team-sweng/
arduino-cli

root@buildbox:/subo/Tooling/bin# ls team-sweng/arduino-cli/
arduino-cli
root@buildbox:/subo/Tooling/bin#

This is then referenced in /etc/profile as part of the path:


    export PATH="/subo/Tooling/bin/team-mecheng/openvsp/OpenVSP-3.23.0-Linux:\
    /subo/Tooling/lib/miniconda/bin:\
    /subo/Tooling/bin/team-sweng/arduino-cli:\
    $PATH"
    

    localuser@buildbox:~$ echo $PATH 
    /subo/Tooling/bin/team-mecheng/openvsp/OpenVSP-3.23.0-Linux:/subo/Tooling/lib/miniconda/bin:/subo/Tooling/bin/team-mecheng/openvsp/OpenVSP-3.23.0-Linux:/subo/Tooling/lib/miniconda/bin:/subo/Tooling/bin/team-sweng/arduino-cli:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin
    localuser@buildbox:~$

We will probably create a /subo/bin directory and symlink things to it and add that to the path (if/when the $PATH environment variable becomes too long)

The path in /etc/profile must be updated on subodev/qa/prod when new software is built on buildbox (and installed to /subo/..../bin)

  • lib is for any non apt-get installed libraries needed for anything we are building from source

  • src is for the (typically) git clone/checkout of upstream software, with a sub directory for each package, just like bin.

  • scripts is for scripts (see immediately below for two key scripts)

Dependency tracking

root@buildbox:/subo/Tooling/scripts# ls
install-build-deps.sh  install-runtime-deps.sh
root@buildbox:/subo/Tooling/scripts#
  • Tracking Build Dependencies

If you apt-get a package/packages to make cmake/configure work, capture it in install-build-deps.sh

  • Tracking Runtime Dependencies If you apt-get a package/packages to make cmake/configure work, capture it in install-runtime-deps.sh

Cross Compilers

Cross compile for pi and make custom images

/subo/Tooling/src/team-sweng/cross-compile/rpi

/subo/Tooling/src/team-sweng/cross-compile/rpi

which contains the current checkout (as of 03/02/2021)


 /subo/Tooling/src/team-sweng/cross-compile/cortexm0

 root@buildbox:/subo/Tooling/src/team-sweng/cross-compile/cortexm0 ls
 binutils-gdb  gcc  newlib-cygwin
 root@buildbox:/subo/Tooling/src/team-sweng/cross-compile/cortexm0 

 /subo/Tooling/src/team-sweng/cross-compile/crosstool-ng

which may well prove easier/better than the raw cloned sources enumerated in the last bullet point.

  • nvidia

We will be making extensive use of Nvidia systems at subo, especially in R&d (for engineering/validation etc)

Also see below under Software Development Kits , the CUDA bullet.

Regular Compilers

buildbox is Ubuntu 20.04 and has bison/flex/autoconf/gcc/g++/build-essential (etc etc) via apt-get install as of 03/02/2021. run apt-get update/upgrade at any time (since anything regulatory scope, we build/install/version lock in /subo/....)

Meta tooling

  • distcc ?
  • ccache ?
  • ninja make?

Software Development Kits

CUDA / JetPack

So this will be a bit tricky. We have three CUDA targets:

1 suboprod vm (hosted on pfv-vmsrv-02)

root@pfv-vmsrv-02:~# lspci |grep -i nv
01:00.0 VGA compatible controller: NVIDIA Corporation GF104GLM [Quadro 3000M] (rev a1)

2 jetson nano (https://developer.nvidia.com/embedded/jetson-nano-developer-kit) (this might? use cuda)

3 suboprod01-05 (tk1) (kepler)

Charles may tackle this, either way it's a (for now) low priority as far as tooling goes for software engineering tooling. On the other hand, hardware/mechanical engineering will have much greater need for this stack for simulations/validation etc (for example https://developer.nvidia.com/blog/drop-in-acceleration-gnu-octave/).

Areas to explore

  • CUDA clustering
  • mixed gpu gens/archs

Links