Nova Resource:Deployment-prep/Help

This page describes the essential bits for people with shell access to Beta Cluster.

Infrastructure

If you are setting up a new instance, remember that Beta Cluster has its own puppetserver. See Help:Project puppetserver for more details.

If you are deleting an instance, follow the Decommission an instance checklist.

Always log all changes to SAL by posting !log message in #wikimedia-releng ^connect!

Beta instance types
Prefix	Usage	`Service names` / Proxies
deployment-acme-chief	Acme-chief active/passive
deployment-cache-text	Caching text, should be renamed deployment-cp	`beta.wmcloud.org` `beta.wmflabs.org` `config-master.wikimedia.beta.wmflabs.org` `m.wikidata.beta.wmflabs.org` `m.wikifunctions.beta.wmflabs.org` `wikidata.beta.wmflabs.org` `wikifunctions.beta.wmflabs.org`
deployment-cache-upload	Caching media, should be renamed deployment-cp	`upload.beta.wmflabs.org` `upload.wikimedia.beta.wmflabs.org`
deployment-changeprop	Changeprop in docker
deployment-cirrussearch	OpenSearch hosts for the Mediawiki CirrusSearch extension
deployment-cumin	Cumin
deployment-db	Databases
deployment-deploy	Scap
deployment-docker	Various services in docker: charts citoid cxserver mathoid mobileapps proton wikifunctions Should be replaced with Kubernetes in the future	https://citoid-beta.wmflabs.org/ https://cxserver-beta.wmcloud.org/ https://mathoid-beta-svc.wmcloud.org/ https://mobileapps.wmcloud.org/ https://proton-beta.wmflabs.org/ https://wikifunctions-evaluator-beta.wmflabs.org/ https://wikifunctions-evaluator-javascript-beta.wmcloud.org/ https://wikifunctions-evaluator-python3-beta.wmcloud.org/ https://wikifunctions-orchestrator-beta.wmflabs.org/
deployment-echostore	EchoStore via Kask in docker	`echostore.svc.deployment-prep.eqiad1.wikimedia.cloud`
deployment-elastic	Search/Elasticsearch Administration
deployment-etcd	Etcd
deployment-eventgate	Event Platform/EventGate in docker	https://eventgate-logging.wmflabs.org/ https://intake-analytics-beta.wmflabs.org/
deployment-eventstreams	Event Platform/EventStreams HTTP Service in docker	https://stream-beta.wmflabs.org/
deployment-imagescaler	Thumbor in docker
deployment-ircd	IRC RC relay (using Obsolete:IRCD in 2025-02-06 audit)	`irc.svc.deployment-prep.eqiad1.wikimedia.cloud` `irc.beta.wmflabs.org`
deployment-jobrunner	MediaWiki jobs called by changeprop
deployment-kafka-jumbo	Kafka webrequests events
deployment-kafka-logging	Kafka ELK logging events
deployment-kafka-main	Kafka eventgate and changeprop events
deployment-maps	Maps	https://maps-beta.wmflabs.org/
deployment-mediawiki	MediaWiki	`appservers.svc.deployment-prep.eqiad1.wikimedia.cloud`
deployment-memc	Memcached
deployment-ms-be	Swift backend
deployment-ms-fe	Swift frontend	`ms-fe.svc.deployment-prep.eqiad1.wikimedia.cloud`
deployment-mwlog	mwlog log files
deployment-mwmaint	MediaWiki maintenance scripts
deployment-mx	Outgoing mail via Exim, BounceHandler	`mail.beta.wmflabs.org`
deployment-puppetdb	Help:Project puppetserver/PuppetDB
deployment-puppetserver	Help:Project puppetserver
deployment-push-notifications	Push notifications in docker	`push-notifications.svc.deployment-prep.eqiad1.wikimedia.cloud` https://pushnotifications.wmflabs.org/
deployment-rdb	Redis (equivalent of redis_misc in production, used for locks)
deployment-restbase	Restbase with Cassandra
deployment-schema	Event Platform/Schemas	https://schema-beta.wmflabs.org/
deployment-sessionstore	SessionStorage via Kask in docker	`sessionstorage.svc.deployment-prep.eqiad1.wikimedia.cloud`
deployment-shellbox	Shellbox in docker	`shellbox.svc.deployment-prep.eqiad1.wikimedia.cloud` `shellbox-video.svc.deployment-prep.eqiad1.wikimedia.cloud` https://shellbox-beta.wmcloud.org/
deployment-snapshot	Dumps
deployment-urldownloader	url-downloader	`url-downloader.svc.deployment-prep.eqiad1.wikimedia.cloud`
deployment-webperf	Excimer UI, XHGui, statsv, navtiming	https://performance.wikimedia.beta.wmflabs.org/
deployment-wikifeeds	Wikifeeds in docker	https://wikifeeds-beta.wmflabs.org/
deployment-wikikube	Kubernetes via Portal:Cloud VPS/Admin/Magnum (phab:T372498, phab:T276650)	`masters.k8s.svc.deployment-prep.eqiad1.wikimedia.cloud` `workers.k8s.svc.deployment-prep.eqiad1.wikimedia.cloud`
deployment-zookeeper	Zookeeper for the deployment-kafka clusters
traindev01	Hand built server running gitlab:repos/releng/train-dev. Contact dancy on #wikimedia-releng ^connect

Secrets

If you are looking for secrets such as ssh key passphrases for keyholder arm, try looking for local commits in /srv/git/labs/private on the active puppetserver. At the time of this writing, many of these passphrases are in files in deployment-puppetserver-1.deployment-prep.eqiad1.wikimedia.cloud:/srv/git/labs/private/files/ssh/tin/. ("tin" was the name of the production deployment server for many years.)

External support services

Not all Beta Cluster related services are actually hosted in the deployment-prep project.

Logstash: https://beta-logs.wmcloud.org/; Access credentials: ssh deployment-deploy04.deployment-prep.eqiad1.wikimedia.cloud -- sudo cat /root/secrets.txt; Hosted by the Logging project
Prometheus alerts: https://prometheus-alerts.wmcloud.org/?q=%40state%3Dactive&q=project%3Ddeployment-prep; Hosted by the Metricsinfra project
Grafana dashboard: https://grafana.wmcloud.org/d/0g9N-7pVz/cloud-vps-project-board?orgId=1&var-project=deployment-prep&var-instance=All; Hosted by the Metricsinfra project