Commit Graph

53 Commits (fee32ec7032ee3cbf785ddfce9f72a8d6c8d3b64)

Author SHA1 Message Date
Thomas E Lackey 10e2311a8b Add timed logging for the webapp build (#771)
Add lots of log and timer output to webapp builds.

Reviewed-on: https://git.vdb.to/cerc-io/stack-orchestrator/pulls/771
2024-02-28 00:38:11 +00:00
Thomas E Lackey a0413659f7 Check for existing tag in remote repo before building. (#764)
Webapp Test / Run webapp test suite (push) Successful in 4m5s Details
Smoke Test / Run basic test suite (push) Successful in 3m55s Details
Deploy Test / Run deploy test suite (push) Successful in 5m13s Details
Publish / Build and publish (push) Successful in 1m5s Details
Lint Checks / Run linter (push) Failing after 3s Details
webapps are meant to be build-once/deploy-many, but we were rebuilding them for every request.  This changes that, so that we rebuild only for every unique ApplicationRecord.

When we push the image, we now tag it according to its ApplicationRecord.

We don't want to use that tag directly in the compose file for the deployment, however, as the deployment needs to be able to adjust to new builds w/o re-writing the file all the time.  Instead, we use a per-deployment unique tag (same as before), we just update what image it references as needed.

Reviewed-on: https://git.vdb.to/cerc-io/stack-orchestrator/pulls/764
2024-02-24 03:22:49 +00:00
Thomas E Lackey 2af6ffce77 Tweaks for running the container registry in k8s (#760)
Lint Checks / Run linter (push) Failing after 3s Details
Publish / Build and publish (push) Successful in 52s Details
Deploy Test / Run deploy test suite (push) Successful in 3m31s Details
Webapp Test / Run webapp test suite (push) Successful in 2m47s Details
Smoke Test / Run basic test suite (push) Successful in 3m52s Details
Fixturenet-Eth-Plugeth-Arm-Test / Run an Ethereum plugeth fixturenet test (push) Has been cancelled Details
Minor tweaks for running the container-registry in k8s.  The big change is not requiring --image-registry.

Reviewed-on: https://git.vdb.to/cerc-io/stack-orchestrator/pulls/760
Reviewed-by: David Boreham <dboreham@noreply.git.vdb.to>
2024-02-22 21:11:06 +00:00
Thomas E Lackey 6bd77c893a Even more logging fixes (#757)
Smoke Test / Run basic test suite (push) Successful in 4m30s Details
Publish / Build and publish (push) Successful in 1m36s Details
Webapp Test / Run webapp test suite (push) Successful in 2m42s Details
Lint Checks / Run linter (push) Failing after 3s Details
Deploy Test / Run deploy test suite (push) Successful in 3m29s Details
Hopefully the last one for a bit.

This only output the cmdline if log_file is present (ie, not to stdout).  It also fixes a bug where the log_file was not passed in one line.

Reviewed-on: https://git.vdb.to/cerc-io/stack-orchestrator/pulls/757
Co-authored-by: Thomas E Lackey <telackey@bozemanpass.com>
Co-committed-by: Thomas E Lackey <telackey@bozemanpass.com>
2024-02-22 01:24:44 +00:00
Thomas E Lackey 4a4d48ddb9 Fix error when logging exception. (#756)
Reviewed-on: https://git.vdb.to/cerc-io/stack-orchestrator/pulls/756
Co-authored-by: Thomas E Lackey <telackey@bozemanpass.com>
Co-committed-by: Thomas E Lackey <telackey@bozemanpass.com>
2024-02-22 00:11:06 +00:00
Thomas E Lackey 08438b1cd5 More logging for webapp deployments (#755)
Reviewed-on: https://git.vdb.to/cerc-io/stack-orchestrator/pulls/755
Co-authored-by: Thomas E Lackey <telackey@bozemanpass.com>
Co-committed-by: Thomas E Lackey <telackey@bozemanpass.com>
2024-02-21 23:48:52 +00:00
Thomas E Lackey 9f1dd284a5 Better error logging for registry deployments. (#754)
Publish / Build and publish (push) Successful in 52s Details
Lint Checks / Run linter (push) Failing after 3s Details
Webapp Test / Run webapp test suite (push) Successful in 2m43s Details
Smoke Test / Run basic test suite (push) Successful in 3m51s Details
Deploy Test / Run deploy test suite (push) Successful in 3m35s Details
We were missing errors related to registration, this should fix that.

Reviewed-on: https://git.vdb.to/cerc-io/stack-orchestrator/pulls/754
Co-authored-by: Thomas E Lackey <telackey@bozemanpass.com>
Co-committed-by: Thomas E Lackey <telackey@bozemanpass.com>
2024-02-21 20:12:52 +00:00
David Boreham 37b9500483 Support non-tls ingress for kind (#748)
Publish / Build and publish (push) Successful in 3m2s Details
Smoke Test / Run basic test suite (push) Successful in 4m16s Details
Webapp Test / Run webapp test suite (push) Successful in 11m15s Details
Lint Checks / Run linter (push) Failing after 4s Details
Deploy Test / Run deploy test suite (push) Successful in 3m34s Details
Reviewed-on: https://git.vdb.to/cerc-io/stack-orchestrator/pulls/748
Co-authored-by: David Boreham <david@bozemanpass.com>
Co-committed-by: David Boreham <david@bozemanpass.com>
2024-02-17 01:54:30 +00:00
David Boreham d9bb6b3588 Test Database Stack (#737)
Smoke Test / Run basic test suite (push) Successful in 3m54s Details
Deploy Test / Run deploy test suite (push) Successful in 3m40s Details
Publish / Build and publish (push) Successful in 50s Details
Webapp Test / Run webapp test suite (push) Successful in 2m33s Details
Lint Checks / Run linter (push) Failing after 3s Details
Reviewed-on: https://git.vdb.to/cerc-io/stack-orchestrator/pulls/737
2024-02-15 05:26:29 +00:00
Thomas E Lackey b22c72e715 For k8s, use provisioner-managed volumes when an absolute host path is not specified. (#741)
In kind, when we bind-mount a host directory it is first mounted into the kind container at /mnt, then into the pod at the desired location.

We accidentally picked this up for full-blown k8s, and were creating volumes at /mnt.  This changes the behavior for both kind and regular k8s so that bind mounts are only allowed if a fully-qualified path is specified.  If no path is specified at all, a default storageClass is assumed to be present, and the volume managed by a provisioner.

Eg, for kind, the default provisioner is: https://github.com/rancher/local-path-provisioner

```
stack: test
deploy-to: k8s-kind
config:
  test-variable-1: test-value-1
network:
  ports:
    test:
     - '80'
volumes:
  # this will be bind-mounted to a host-path
  test-data-bind: /srv/data
  # this will be managed by the k8s node
  test-data-auto:
configmaps:
  test-config: ./configmap/test-config
```

Reviewed-on: https://git.vdb.to/cerc-io/stack-orchestrator/pulls/741
Co-authored-by: Thomas E Lackey <telackey@bozemanpass.com>
Co-committed-by: Thomas E Lackey <telackey@bozemanpass.com>
2024-02-14 21:45:01 +00:00
Thomas E Lackey c9444591f5 Fix default webapp port number. (#740)
Lint Checks / Run linter (push) Failing after 3s Details
Deploy Test / Run deploy test suite (push) Successful in 3m27s Details
Smoke Test / Run basic test suite (push) Successful in 3m54s Details
Publish / Build and publish (push) Successful in 51s Details
Webapp Test / Run webapp test suite (push) Successful in 2m41s Details
Reviewed-on: https://git.vdb.to/cerc-io/stack-orchestrator/pulls/740
Co-authored-by: Thomas E Lackey <telackey@bozemanpass.com>
Co-committed-by: Thomas E Lackey <telackey@bozemanpass.com>
2024-02-09 01:20:41 +00:00
Thomas E Lackey 903f3b10e2 Add support for annotations and labels in spec. (#739)
```
stack: webapp-deployer-backend
deploy-to: k8s
annotations:
  foo.bar.annot/{name}: baz
labels:
  a.b.c/{name}.blah: "value"
```

Reviewed-on: https://git.vdb.to/cerc-io/stack-orchestrator/pulls/739
Co-authored-by: Thomas E Lackey <telackey@bozemanpass.com>
Co-committed-by: Thomas E Lackey <telackey@bozemanpass.com>
2024-02-09 00:11:07 +00:00
Thomas E Lackey 72ed2eb91a Fix bad test in tag check. (#738)
Publish / Build and publish (push) Successful in 50s Details
K8s Deploy Test / Run deploy test suite on kind/k8s (push) Failing after 1m3s Details
Webapp Test / Run webapp test suite (push) Successful in 3m2s Details
Smoke Test / Run basic test suite (push) Successful in 3m48s Details
Lint Checks / Run linter (push) Failing after 3s Details
Deploy Test / Run deploy test suite (push) Successful in 3m30s Details
Reviewed-on: https://git.vdb.to/cerc-io/stack-orchestrator/pulls/738
Co-authored-by: Thomas E Lackey <telackey@bozemanpass.com>
Co-committed-by: Thomas E Lackey <telackey@bozemanpass.com>
2024-02-08 20:38:41 +00:00
David Boreham 8be1e684e8 Process environment variables defined in compose files (#736)
Reviewed-on: https://git.vdb.to/cerc-io/stack-orchestrator/pulls/736
Co-authored-by: David Boreham <david@bozemanpass.com>
Co-committed-by: David Boreham <david@bozemanpass.com>
2024-02-08 19:41:57 +00:00
Thomas E Lackey 3309782439 Refactor 2024-02-08 00:47:46 -06:00
Thomas E Lackey 4b3b3478e7 Switch to Docker-style limits 2024-02-08 00:43:41 -06:00
Thomas E Lackey 2a9955055c debug 2024-02-07 16:56:35 -06:00
Thomas E Lackey 8964e1c0fe Add resource limit options to spec. 2024-02-07 16:48:02 -06:00
Thomas E Lackey d2ebb81d77 Tags for undeploy (#734)
Publish / Build and publish (push) Successful in 50s Details
Deploy Test / Run deploy test suite (push) Successful in 3m14s Details
Smoke Test / Run basic test suite (push) Successful in 3m53s Details
Lint Checks / Run linter (push) Failing after 4s Details
Webapp Test / Run webapp test suite (push) Successful in 2m42s Details
```
  --include-tags TEXT             Only include requests with matching tags
                                  (comma-separated).
  --exclude-tags TEXT             Exclude requests with matching tags (comma-
                                  separated).
```

Reviewed-on: https://git.vdb.to/cerc-io/stack-orchestrator/pulls/734
Co-authored-by: Thomas E Lackey <telackey@bozemanpass.com>
Co-committed-by: Thomas E Lackey <telackey@bozemanpass.com>
2024-02-07 21:45:16 +00:00
Thomas E Lackey 88a0236ca9 Add the ability to filter deployment requests by tag. (#730)
Lint Checks / Run linter (push) Failing after 10s Details
Deploy Test / Run deploy test suite (push) Successful in 3m5s Details
Smoke Test / Run basic test suite (push) Successful in 3m55s Details
Publish / Build and publish (push) Successful in 53s Details
Webapp Test / Run webapp test suite (push) Successful in 2m37s Details
Reviewed-on: https://git.vdb.to/cerc-io/stack-orchestrator/pulls/730
2024-02-07 03:12:40 +00:00
David Boreham bfbcfb7904
Volume processing fixes (#729)
Publish / Build and publish (push) Successful in 55s Details
Deploy Test / Run deploy test suite (push) Successful in 2m58s Details
Webapp Test / Run webapp test suite (push) Successful in 2m42s Details
Smoke Test / Run basic test suite (push) Successful in 3m57s Details
2024-02-06 12:32:10 -07:00
David Boreham 6848fc33cf
Implement dry run support for k8s deploy (#727) 2024-02-06 07:07:56 -07:00
Thomas E Lackey 36bb068983
Add ConfigMap test. (#726)
Publish / Build and publish (push) Successful in 1m24s Details
Deploy Test / Run deploy test suite (push) Successful in 2m52s Details
K8s Deploy Test / Run deploy test suite on kind/k8s (push) Failing after 1m3s Details
Webapp Test / Run webapp test suite (push) Successful in 2m40s Details
Smoke Test / Run basic test suite (push) Successful in 4m24s Details
* Add ConfigMap test.

* eof

* Minor tweak

* Trigger test

---------

Co-authored-by: David Boreham <david@bozemanpass.com>
2024-02-05 14:15:11 -06:00
Thomas E Lackey 2fcd416e29
Basic webapp deployer stack. (#722)
Webapp Test / Run webapp test suite (push) Successful in 2m35s Details
Smoke Test / Run basic test suite (push) Successful in 3m46s Details
Publish / Build and publish (push) Successful in 50s Details
Deploy Test / Run deploy test suite (push) Successful in 2m56s Details
2024-02-02 19:05:15 -07:00
Thomas E Lackey 6629017d6a
Support other webapp types (react, static). (#721)
* Support other webapp types (react, static).
2024-02-02 18:04:06 -06:00
Thomas E Lackey b398050787
Don't include volumes in spec if we don't have any. (#720)
Publish / Build and publish (push) Successful in 51s Details
Deploy Test / Run deploy test suite (push) Successful in 3m3s Details
Webapp Test / Run webapp test suite (push) Successful in 3m6s Details
Smoke Test / Run basic test suite (push) Successful in 4m56s Details
2024-01-31 15:11:32 -06:00
Thomas E Lackey 12ec1bec43
Add ConfigMap support for k8s. (#714)
Publish / Build and publish (push) Successful in 50s Details
Deploy Test / Run deploy test suite (push) Successful in 3m7s Details
Webapp Test / Run webapp test suite (push) Successful in 2m38s Details
Smoke Test / Run basic test suite (push) Successful in 3m45s Details
* Minor fixes for deploying with k8s and podman.

* ConfigMap support
2024-01-30 23:09:48 -06:00
Thomas E Lackey 62af03077f
Add deployed/error status output to the state file. (#719)
* More status info
* Up default resource limits.
* Need ps
2024-01-30 22:13:45 -06:00
Thomas E Lackey 428b05158e
Fix DnsRecord ownership check. (#718)
Smoke Test / Run basic test suite (push) Successful in 3m45s Details
Publish / Build and publish (push) Successful in 58s Details
Deploy Test / Run deploy test suite (push) Successful in 3m3s Details
K8s Deploy Test / Run deploy test suite on kind/k8s (push) Failing after 1m3s Details
Webapp Test / Run webapp test suite (push) Successful in 2m44s Details
* Fix DnsRecord ownership check.

* Var names
2024-01-30 13:31:59 -06:00
David Boreham 1f9653e6f7
Fix kind mode and add k8s deployment test (#704)
* Fix kind mode and add k8s deployment test

* Fix lint errors
2024-01-16 15:55:58 -07:00
Thomas E Lackey b83030f63b
Use custom act with gitea. (#700)
Publish / Build and publish (push) Successful in 55s Details
Deploy Test / Run deploy test suite (push) Successful in 2m51s Details
K8s Deploy Test / Run deploy test suite (push) Failing after 3m32s Details
Webapp Test / Run webapp test suite (push) Successful in 2m59s Details
Smoke Test / Run basic test suite (push) Successful in 5m28s Details
* Use custom act with gitea.

* Make sure wget is available

* Fix repo url
2024-01-09 22:53:43 -06:00
Thomas E Lackey 837e443800
Support application removal requests. (#697)
Publish / Build and publish (push) Successful in 1m10s Details
Deploy Test / Run deploy test suite (push) Successful in 3m18s Details
K8s Deploy Test / Run deploy test suite (push) Failing after 3m3s Details
Webapp Test / Run webapp test suite (push) Failing after 2m34s Details
Smoke Test / Run basic test suite (push) Successful in 4m12s Details
* Support application removal request.

* Git should never prompt when deploying a webapp
2023-12-21 18:05:40 -06:00
David Boreham d8357df345
Add image pull secret to pods (#692)
Publish / Build and publish (push) Successful in 56s Details
Deploy Test / Run deploy test suite (push) Successful in 3m16s Details
K8s Deploy Test / Run deploy test suite (push) Failing after 3m14s Details
Webapp Test / Run webapp test suite (push) Failing after 2m37s Details
Smoke Test / Run basic test suite (push) Successful in 4m26s Details
2023-12-15 14:27:45 -07:00
Thomas E Lackey 27a14737f8
Make the container tag based on the deployment path. (#688)
Publish / Build and publish (push) Successful in 58s Details
Deploy Test / Run deploy test suite (push) Successful in 3m24s Details
K8s Deploy Test / Run deploy test suite (push) Failing after 3m2s Details
Webapp Test / Run webapp test suite (push) Failing after 3m33s Details
Smoke Test / Run basic test suite (push) Successful in 4m0s Details
2023-12-14 09:49:21 -06:00
Thomas E Lackey 1f4eb57069
Add --dry-run option (#686)
Webapp Test / Run webapp test suite (push) Failing after 3m51s Details
Smoke Test / Run basic test suite (push) Successful in 3m59s Details
Publish / Build and publish (push) Successful in 56s Details
Deploy Test / Run deploy test suite (push) Successful in 3m12s Details
K8s Deploy Test / Run deploy test suite (push) Failing after 3m10s Details
2023-12-13 22:56:40 -06:00
Thomas E Lackey 88f66a3626
Add `deployment update` and `deploy-webapp-from-registry` commands. (#676) 2023-12-13 21:02:34 -06:00
Thomas E Lackey 077ea80c70
Add `deployment status` command and fix k8s output for `deployment ps` (#679)
Publish / Build and publish (push) Successful in 59s Details
Deploy Test / Run deploy test suite (push) Successful in 3m13s Details
K8s Deploy Test / Run deploy test suite (push) Failing after 3m16s Details
Webapp Test / Run webapp test suite (push) Failing after 3m48s Details
Smoke Test / Run basic test suite (push) Successful in 4m25s Details
2023-12-06 09:27:47 -07:00
David Boreham 15faed00de
Generate a unique deployment id for each deployment (#680)
Publish / Build and publish (push) Successful in 1m8s Details
Deploy Test / Run deploy test suite (push) Successful in 3m13s Details
K8s Deploy Test / Run deploy test suite (push) Failing after 3m16s Details
Webapp Test / Run webapp test suite (push) Failing after 3m44s Details
Smoke Test / Run basic test suite (push) Successful in 4m40s Details
* Move cluster name generation into a function

* Generate a unique deployment id for each deployment
2023-12-05 22:56:58 -07:00
Thomas E Lackey ab0e70ed83
Change path portion of unique cluster name to point to compose file, not argv[0]. (#678)
Publish / Build and publish (push) Successful in 1m6s Details
Deploy Test / Run deploy test suite (push) Successful in 3m28s Details
K8s Deploy Test / Run deploy test suite (push) Failing after 3m16s Details
Webapp Test / Run webapp test suite (push) Failing after 3m55s Details
Smoke Test / Run basic test suite (push) Successful in 4m8s Details
2023-12-04 13:39:14 -06:00
David Boreham d7093277b4
Use constants (#671) 2023-11-29 20:50:53 -07:00
Thomas E Lackey 03a3645b3c
Add --port option to run-webapp. (#667)
K8s Deploy Test / Run deploy test suite (push) Failing after 3m1s Details
Webapp Test / Run webapp test suite (push) Failing after 3m30s Details
Smoke Test / Run basic test suite (push) Successful in 4m2s Details
Publish / Build and publish (push) Successful in 58s Details
Deploy Test / Run deploy test suite (push) Successful in 3m18s Details
* Add --port option to run-webapp

* Fixed merge

* lint
2023-11-29 11:32:28 -06:00
David Boreham 113c0bfbf1
Propagate env file for webapp deployment (#669)
Deploy Test / Run deploy test suite (push) Successful in 3m21s Details
K8s Deploy Test / Run deploy test suite (push) Failing after 3m7s Details
Webapp Test / Run webapp test suite (push) Failing after 3m53s Details
Smoke Test / Run basic test suite (push) Successful in 4m7s Details
Publish / Build and publish (push) Successful in 57s Details
2023-11-28 21:14:02 -07:00
David Boreham 1a069a6816
Use a temp file for the spec file name (#668) 2023-11-28 19:56:12 -07:00
David Boreham a68cd5d65c
Webapp deploy (#662)
Webapp Test / Run webapp test suite (push) Failing after 4m1s Details
Smoke Test / Run basic test suite (push) Successful in 4m14s Details
Publish / Build and publish (push) Successful in 58s Details
Deploy Test / Run deploy test suite (push) Successful in 3m40s Details
K8s Deploy Test / Run deploy test suite (push) Failing after 3m20s Details
2023-11-27 22:02:16 -07:00
David Boreham 87bedde5cb
Support for k8s ingress and tls (#659)
Smoke Test / Run basic test suite (push) Successful in 4m9s Details
Publish / Build and publish (push) Successful in 1m3s Details
Deploy Test / Run deploy test suite (push) Successful in 3m1s Details
K8s Deploy Test / Run deploy test suite (push) Failing after 3m4s Details
Webapp Test / Run webapp test suite (push) Failing after 3m34s Details
2023-11-21 16:04:36 -07:00
David Boreham 01029cf7aa
Fix for code path that doesn't create a DeploymentContext (#658) 2023-11-21 08:35:31 -07:00
David Boreham f6624cb33a
Add image push command (#656)
Publish / Build and publish (push) Successful in 57s Details
Deploy Test / Run deploy test suite (push) Successful in 3m6s Details
K8s Deploy Test / Run deploy test suite (push) Failing after 3m10s Details
Webapp Test / Run webapp test suite (push) Failing after 3m37s Details
Smoke Test / Run basic test suite (push) Successful in 4m8s Details
2023-11-20 20:23:55 -07:00
David Boreham c9c6a0eee3
Changes for remote k8s (#655)
Publish / Build and publish (push) Successful in 1m2s Details
Deploy Test / Run deploy test suite (push) Successful in 3m6s Details
K8s Deploy Test / Run deploy test suite (push) Failing after 3m4s Details
Webapp Test / Run webapp test suite (push) Failing after 3m36s Details
Smoke Test / Run basic test suite (push) Successful in 4m4s Details
2023-11-20 09:12:57 -07:00
Thomas E Lackey 5c80887215
Fix missing tty parameter. (#653)
Smoke Test / Run basic test suite (push) Successful in 3m55s Details
Publish / Build and publish (push) Successful in 59s Details
Deploy Test / Run deploy test suite (push) Successful in 3m3s Details
K8s Deploy Test / Run deploy test suite (push) Failing after 2m59s Details
Webapp Test / Run webapp test suite (push) Failing after 3m34s Details
2023-11-16 12:58:03 -06:00
Thomas E Lackey 2059d67dca
Add run-webapp command. (#651) 2023-11-15 10:54:27 -07:00