Repo focused on advanced knowledge, tips & tricks, debugging & fixes.

I'm gradually migrating my huge private personal knowledge base into this public repo.

Hit the watch button on the top right for updates.

Some of these pages are still in progress pending porting from my private knowledge base pages, some are still stubs pending migration.

References to official docs and some classic books are provided for those who want to thoroughly cover the basics.

Even more deep advanced knowledge is captured in well commented code - references to my major GitHub Repos are provided throughout where relevant.

A few highlight pages:

• • /
• /

You can find the other more specialist stuff below in the full index.

The full index is further down.

• Travel
• GitHub Repos
• Systems
  • Operating Systems
  • Core Services - DNS, DHCP, SSH, FTP
  • Editors
  • Terminal Multiplexers
• Architecture & Documentation
• Git
• Cloud
• Containerization
  • Docker
  • Kubernetes
    • Kubernetes Core
    • Cloud Hosted Kubernetes
    • On-premise Kubernetes
    • Local Kubernetes Dev
    • Kubernetes Applications & Lifecycle Management
  • Container Registries
  • Container Security
• Programming
  • Languages
  • Build Systems
  • Mobile Builds
  • Artifact Registries
  • Code Scanning
• Infrastructure-as-Code
• Configuration Management
• CI/CD
• Internet Services
• Databases / RDBMS
  • MPP Databases
  • Hosted MPP Databases
  • Database Management
• NoSQL
  • Caching
  • Search
• Coordination & Discovery Services
• Pub / Sub & Message Queues
• Data
  • Data Formats
  • Hadoop Ecosystem
  • Data Science & Machine Learning
  • Time Series Databases
  • Visualization
• Security
• Virtualization
• Hardware
• Networking
  • Load Balancing
• Monitoring
  • Performance Engineering
• AI & Automation
• Work
  • Remote Working & Digital Nomad
  • Training & Interview Materials
  • Banking Industry
• Miscellaneous
  • Dev / DevOps / Open Source / Agile
  • Vendors
  • Multimedia
  • Marketing
  • Blogging
  • Crypto
  • Old Docs
• Star History
• Memes
  • This is the Lost Documentation
• More Core Repos
  • Knowledge
  • DevOps Code
  • Containerization Repos
  • CI/CD Repos
  • DBA - SQL
  • DevOps Reloaded
  • Templates
  • Spotify
• Other Resources

• Travel Knowledge - tips from travelling the world extensively for both fun and profit - consulted on 4 continents, worked as a digital nomad and travel the world 52 weeks a year - life is short, take it:
  • my favourite restaurants
  • flights & accommodation
  • mobile internet access & e-sim providers
  • visas
  • driving around Europe on road trips each summer
  • various other travel tips specific to each of 40+ countries and 100+ towns and cities across 4 continents
• Remote Working & Digital Nomad - specific notes on remote working and as a digital nomad
• Blogging - because sharing is caring...

Full of open source tools and scripts used throughout the rest of these docs to make it easier to install and operate these technologies:

• DevOps-Bash-tools - 1000+ Bash scripts, advanced shell environment customizations, quick installation scripts and dot configs
• DevOps-Python-tools - 80+ Python programs for DevOps & Data
• DevOps-Perl-tools - 25+ Perl programs for DevOps
• DevOps-Golang-tools - a handful of Golang programs
• Kubernetes-configs - many Kubernetes applications and advanced templates with Tips & Tricks from production environments
• SQL-scripts - 100+ database scripts
• Templates - templates for many common file formats for programming languages, build systems and DevOps configs
• Diagrams-as-Code - Cloud & Open Source architecture diagrams

This one is used widely throughout these pages:

• Linux
  • Debian
  • Ubuntu
  • Redhat
  • Alpine
  • Gentoo
• Windows
• Mac
  • Homebrew
  • Raycast
• Shell
  • Bash Scripting
    • Sudo
  • direnv / .envrc
  • Shell One Liners
  • Advanced & Third Party Commands
• Disk Management
• Logging
  • Syslog-ng
  • RSyslog

• SSH
  • SSH Tunnelling
• FTP
• DNS
• DHCP

• Editors & IDEs
  • Vim
  • IntelliJ
  • VS Code
• Coder

• Screen
• Tmux

• Architecture TODO
• Best Practices
• Product Selection TODO
• Diagrams-as-Code
  • D2 lang
  • MermaidJS
• Documentation
  • Markdown
  • MkDocs
• Microservices TODO
• Medium.com (blog)
• System Design

• Git
  • Git Workflow Branching Strategies
• Git Repo Hosting Providers:
  • GitHub (TODO: partially ported)
  • GitLab
  • Azure DevOps
  • Bitbucket (TODO: partially ported)
• Pre-Commit

• Cloud
• Cloud Platforms:
  • AWS
    • AMI Scanning
  • GCP
    • Firebase
  • Azure
  • Digital Ocean
• Third Party Tools:
  • MinIO
  • HashiCorp Vault
  • Keeper
• PaaS

• Docker
  • Dockerfile TODO
  • Docker Compose
  • Docker Swarm
• Podman
• Dockerfiles for many technologies:

• Kubernetes
• Kubernetes Upgrades
• Kubernetes Configs
• Kubernetes Production Ready Checklist
• Traefik
• Kong API Gateway
• Istio TODO
  • Kiali
• Kubeflow TODO

• AWS EKS TODO partial
  • EKS Upgrades
• GKE TODO
• AKS TODO
• Karpenter

• K3s
• Rancher
• RKE2
• Portworx

• Docker Desktop embedded Kubernetes (easiest to use)
• MiniKube
• MiniShift - for OpenShift upstream okd
• K3d
• Kind

• Helm
• Kustomize
  • Helm vs Kustomize
• ArgoCD
• Cert Manager
• Kubernetes Configs:

• DockerHub
• AWS ECR
• GCP GAR
  • GCP GCR (deprecated / shut down)
• Azure ACR
• GitHub GHCR
• Redhat Quay.io (there is an on-prem installable too)
• JFrog Container Registry
• Nexus
• Harbor
• Chart Museum

• Container Scanning
• Trivy
• Grype
• Clair

• Programming
• Binaries Debugging

• Perl
• Python
  • Anaconda
• Golang TODO partial
• Rust
• Ruby
• R TODO
• TCL / Expect
• JVM:
  • Java TODO partial
  • JDBC
  • JVM Performance Tuning
  • Groovy
  • Scala TODO
  • Jython
  • JRuby
  • SDKman
  • log4j
• JavaScript / NodeJS
• Lua
• APIs
• Regular Expressions
• Testing

• Build Systems
• Make
• Maven
• Gradle
• SBT
• Fastlane

• Mobile Builds
• iOS
  • iXGuard
• Android
• Fastlane

• Artifact Registries
• Artifactory
• Nexus TODO

• Code Scanning
  • Trivy
  • Grype
• Code Quality
  • SonarQube
  • SonarCloud
  • CodeClimate

• Terraform
  • tfenv
  • Terragrunt
    • tgswitch
  • Atlantis
• Pulumi
• Packer

• Ansible
• Puppet TODO
• YAML

• CI/CD
• Mobile CI/CD
  • Mobile Builds
  • Fastlane
  • Firebase
• Self-Hosted CI/CD:
  • Jenkins
    • Jenkins-on-Kubernetes
    • HariSekhon/Jenkins - master Jenkinsfile template and Groovy Shared Library functions
  • TeamCity TODO
    • HariSekhon/TeamCity-CI
  • Concourse
  • GoCD TODO
• Git Repo Providers hosted CI/CD:
  • GitHub Actions
  • GitLab CI TODO
  • Azure DevOps TODO
  • Bitbucket Pipelines TODO
• 3rd Party hosted CI/CD:
  • CircleCI
  • TravisCI
  • Codefresh
  • Drone.io

• Web
• CDNs
  • Cloudflare
• HTTP Proxying
• APIs

• SQL TODO
• SQL scripts
• Databases
• Data Warehousing TODO
• MySQL TODO partial
• PostgreSQL TODO partial
• Oracle
• SQLite
• CloudBeaver

Massively Parallel Processing databases - horizontally scaling databases:

• Vertica
• Greenplum
• Impala TODO
• Presto
• Apache Drill

• Distributed SQL
• Snowflake
• Google BigQuery TODO
• AWS Redshift TODO

See also the Hadoop Ecosystem section further down for more distributed SQL databases.

• LiquiBase TODO
• AtlasGo
• ByteBase TODO

• Cassandra TODO
• Couchbase
• HBase TODO
• MongoDB TODO
• Neo4j

• Redis TODO
• Memcached
• Couchbase
• Oracle Coherence

• Search
• Elasticsearch
  • Kibana
• Solr
• Logstash TODO

• Consul
• Etcd
• ZooKeeper

• Pub / Sub & Message Queues
• Kafka
• RabbitMQ
• Celery
• AWS Kinesis

• Data
• Big Data
• Data Warehousing TODO
• Spark TODO
• Airflow TODO
• Apache Camel
• JSON
• DVC
• Informatica

• Data Formats
• Avro
• Parquet
• JSON

• Spark TODO
• Kafka
• Hadoop TODO
  • Kerberos Hadoop TODO
  • YARN TODO
  • HDFS TODO
• Pig TODO
• Hive TODO
  • Sqoop
• Impala TODO
• Presto
• Apache Drill
• Kudu
• Kylin
• Storm TODO
• Mahout
• ZooKeeper

• Data Science TODO
• Machine Learning TODO
• Python
  • Anaconda
• DVC
• R TODO
• Octave TODO

• OpenTSDB
  • TCollector
• T.I.C.K. platform:
  • Telegraf TODO
  • InfluxDB
  • Chronograf TODO
  • Kapacitor

• Visualization
• Tableau

• Security TODO
• Encryption:
  • SSL TODO
  • VeraCrypt
  • Mac Native Encryption
• Kerberos TODO
• FreeIPA TODO
• Keycloak
• Penetration Testing TODO
• Secret Managers
  • HashiCorp Vault
  • Keeper
• SOC - Security Operations Center
• Code Scanning
• Code Quality
• Container Scanning
• AMI Scanning

• Virtualization
• VirtualBox
• Vagrant
• Packer
• OpenStack TODO
• KVM

• Hardware
• Storage

• Networking TODO
• Firewalls
• VPNs
• Cisco TODO
• Juniper TODO
• Foundry TODO
• Keepalived

• Load Balancing TODO
• HAProxy
• F5

• Monitoring
• Nagios
• Prometheus
• Thanos TODO
• Grafana TODO (partial)
• Notifications
  • OpsGenie
  • PagerDuty TODO
• Fluentd

• Performance Engineering
• Stress Testing

• AI
• Automation

• Remote Working & Digital Nomad
  • Travel

• Training
• Interview Materials

• Banking Industry

• DevOps Misc
• Dev Misc
• Open Source
• Internet Miscellaneous
• TamperMonkey
• Jira
• Agile
• Google Drive
• Spreadsheets
• IRC
• Communications - Chat & Video Conferencing

• Hashicorp
• Confluent
• Atlassian
  • Jira

• Multimedia
  • PDF
  • Image
  • Video
    • MPV
    • YouTube Downloader
  • Audio
    • Spotify
    • Shazam
• Download Tools
• File Upload & Code Pastebin Sites
• Memes
• Social Media

• Marketing

• Blogging
• Wordpress

This section is probably the most financially important thing you'll ever learn.

• Bitcoin
  • more financially beneficial than your Tech knowledge
  • the most important knowledge along with avoiding feminist divorce law
• Crypto - TODO
  • every day you're not in crypto you're losing money due to constant inflationary money printing by central banks and governments to fund budgetary deficits caused by universal suffrage spending liabilities
  • even many investments, which are also taxed and often confiscated by governments or ex-wives, are losing ground to inflation in real terms

• Hazelcast
• Mesos
• DataHash

Here the TODOs are all getting filled in gradually... because we've all been here:

From my LinkedIn:

I tried to make these docs as short as possible... but as you can see above, I didn't quite make it.

I've been both the bottom and top of this meme:

The rest of my original source repos are here.

Pre-built Docker images are available on my DockerHub.

papers-we-love/papers-we-love