# Rack (Version 3) **URL:** https://community.convox.com/c/rack-v3/16.md [Latest](https://community.convox.com/latest.md) · [Categories](https://community.convox.com/categories.md) --- ## [Deploys broken after updating to 3.12.0](https://community.convox.com/t/deploys-broken-after-updating-to-3-12-0/913)
**Author:** [@nathan.f77](https://community.convox.com/u/nathan.f77)\ **Replies:** 3\ **Last updated:** [June 21, 2025, 6:42pm UTC](https://community.convox.com/t/deploys-broken-after-updating-to-3-12-0/913 "2025-06-21T18:42:23Z")
Hello, I’m running into an authorization error after updating to 3.12.0 with the new buildkit for image building. I had to re-add my Docker Hub registry, and attempted to re-add the AWS ECR registry, but I’m getting a 4… --- ## [Unable to set rack params](https://community.convox.com/t/unable-to-set-rack-params/927)
**Author:** [@luke.mcmanus](https://community.convox.com/u/luke.mcmanus)\ **Replies:** 3\ **Last updated:** [June 21, 2025, 7:03am UTC](https://community.convox.com/t/unable-to-set-rack-params/927 "2025-06-21T07:03:17Z")
I’m trying to add a WhiteList rack param, however I’m getting this error: Updating parameters... ERROR: direct rack doesn't support update, make sure you are not using RACK\_URL environment variable I’ve tested this on … --- ## [Verify that you have permission to create service linked role](https://community.convox.com/t/verify-that-you-have-permission-to-create-service-linked-role/961)
**Author:** [@rhysawilliams2010](https://community.convox.com/u/rhysawilliams2010)\ **Replies:** 6\ **Last updated:** [February 28, 2025, 12:01am UTC](https://community.convox.com/t/verify-that-you-have-permission-to-create-service-linked-role/961 "2025-02-28T00:01:54Z")
I had an error when attempting to create a new rds-postgres resource: Verify that you have permission to create service linked role. To resolve the issue I had to manually update the “api-rds-provisioner” inline policy… --- ## [DNS search suffixes for non-internal services](https://community.convox.com/t/dns-search-suffixes-for-non-internal-services/701)
**Author:** [@julian](https://community.convox.com/u/julian)\ **Replies:** 2\ **Last updated:** [February 24, 2025, 8:07pm UTC](https://community.convox.com/t/dns-search-suffixes-for-non-internal-services/701 "2025-02-24T20:07:30Z")
It seems from the documentation and some experimentation that the DNS shortcuts for peer services, e.g. auth.myapp.convox.local, auth.myapp, auth are only set if the service is internal: true. Is this true, and if so, i… --- ## [awsEfs mount for MQTT](https://community.convox.com/t/awsefs-mount-for-mqtt/962)
**Author:** [@rhysawilliams2010](https://community.convox.com/u/rhysawilliams2010)\ **Replies:** 2\ **Last updated:** [February 21, 2025, 5:37pm UTC](https://community.convox.com/t/awsefs-mount-for-mqtt/962 "2025-02-21T17:37:16Z")
Hello, I am attempting to set up an MQTT cluster but I have a couple of problems. version: '3' resources: balancers: custom: service: mqtt ports: 1883: 1883 9001: 9001 services: mqtt: image… --- ## [Feature request: ARM support (for AWS Graviton instances, etc.)](https://community.convox.com/t/feature-request-arm-support-for-aws-graviton-instances-etc/956)
**Author:** [@nathan.f77](https://community.convox.com/u/nathan.f77)\ **Replies:** 1\ **Last updated:** [October 2, 2024, 11:10pm UTC](https://community.convox.com/t/feature-request-arm-support-for-aws-graviton-instances-etc/956 "2024-10-02T23:10:20Z")
Is it possible to run a Convox rack on ARM instances? We have a new customer who is running a k8s cluster on AWS Graviton instances. They requested an ARM64 version of our on-premise Docker images. They reported that “c… --- ## [Has anyone restricted access to the rack API service? I would like to only allow access through a Tailscale VPN connection](https://community.convox.com/t/has-anyone-restricted-access-to-the-rack-api-service-i-would-like-to-only-allow-access-through-a-tailscale-vpn-connection/949)
**Author:** [@nathan.f77](https://community.convox.com/u/nathan.f77)\ **Replies:** 2\ **Last updated:** [September 23, 2024, 12:14pm UTC](https://community.convox.com/t/has-anyone-restricted-access-to-the-rack-api-service-i-would-like-to-only-allow-access-through-a-tailscale-vpn-connection/949 "2024-09-23T12:14:01Z")
I would like to prevent public access to the API service and only allow access from the private network. I just set up a Tailscale subnet router service to access some private services that I’m running on render.com, an… --- ## [Need help with VPC to access a database](https://community.convox.com/t/need-help-with-vpc-to-access-a-database/940)
**Author:** [@alfredo.e.alvarez](https://community.convox.com/u/alfredo.e.alvarez)\ **Replies:** 1\ **Last updated:** [February 7, 2024, 2:27am UTC](https://community.convox.com/t/need-help-with-vpc-to-access-a-database/940 "2024-02-07T02:27:51Z")
I have a V3 rack running a web application it was made on a new VPC. Our system has a database that is in a different VPC. I tried recreating the rack on the same VPC but it failed halfway thru. Then tried peering i g… --- ## [Convox Rack In Unknown State repeatedly](https://community.convox.com/t/convox-rack-in-unknown-state-repeatedly/937)
**Author:** [@kalquaddoomi](https://community.convox.com/u/kalquaddoomi)\ **Replies:** 1\ **Last updated:** [October 11, 2023, 12:48pm UTC](https://community.convox.com/t/convox-rack-in-unknown-state-repeatedly/937 "2023-10-11T12:48:17Z")
I am running a V3 rack using AWS as the provider that was previously functional, but has now twice dropped into “Unknown” status without any specific change on my part. Efforts to reach the rack via CLI return back “ERRO… --- ## [Convox audit logs](https://community.convox.com/t/convox-audit-logs/917)
**Author:** [@rhys](https://community.convox.com/u/rhys)\ **Replies:** 1\ **Last updated:** [June 27, 2023, 1:02am UTC](https://community.convox.com/t/convox-audit-logs/917 "2023-06-27T01:02:34Z")
I can see audit logs are available via the web app, but they are hard to navigate/ search. They are also difficult to download. Is there some way I can access the “audit log” data more directly? I can’t find it in cloud… --- ## [RESOLVED! Production app stuck "updating"](https://community.convox.com/t/resolved-production-app-stuck-updating/888)
**Author:** [@rhys](https://community.convox.com/u/rhys)\ **Replies:** 3\ **Last updated:** [May 26, 2023, 4:45pm UTC](https://community.convox.com/t/resolved-production-app-stuck-updating/888 "2023-05-26T16:45:08Z")
Hello, my production app is stuck “updating” If i try to promote a new release i get “waiting for app to be ready…” If i check the app it says its updating If i attempt to cancel the app, it tells me it’s not upd… --- ## [Disable timers using schedule expression](https://community.convox.com/t/disable-timers-using-schedule-expression/899)
**Author:** [@vdubey](https://community.convox.com/u/vdubey)\ **Replies:** 1\ **Last updated:** [November 13, 2022, 7:04am UTC](https://community.convox.com/t/disable-timers-using-schedule-expression/899 "2022-11-13T07:04:45Z")
As per docs: Convox Docs timers: cleanup: command: bin/cleanup schedule: "\*/1 \* \* \* ?" service: timers Is there a way to disable triggering timers without removing the entry from the timers? --- ## [Multi region rack?](https://community.convox.com/t/multi-region-rack/903)
**Author:** [@edaniel.palval](https://community.convox.com/u/edaniel.palval)\ **Replies:** 0\ **Last updated:** [November 10, 2022, 1:15am UTC](https://community.convox.com/t/multi-region-rack/903 "2022-11-10T01:15:08Z")
Is there any feature that allows to have the same deployment in two separated regions/racks in order to have a failover? --- ## [Feedback on v3 Racks?](https://community.convox.com/t/feedback-on-v3-racks/728)
**Author:** [@ed\_convox](https://community.convox.com/u/ed_convox)\ **Replies:** 9\ **Last updated:** [November 8, 2022, 3:42am UTC](https://community.convox.com/t/feedback-on-v3-racks/728 "2022-11-08T03:42:10Z")
With the Kubernetes-based Racks being released for a few weeks now, we’re wondering who has tried them out? If you have, how have you found them? If you haven’t, what’s stopped you from doing so? Free credits are avail… --- ## [HTTP headers from load balancer not specifying real client IP](https://community.convox.com/t/http-headers-from-load-balancer-not-specifying-real-client-ip/750)
**Author:** [@nickf](https://community.convox.com/u/nickf)\ **Replies:** 3\ **Last updated:** [November 4, 2022, 1:46am UTC](https://community.convox.com/t/http-headers-from-load-balancer-not-specifying-real-client-ip/750 "2022-11-04T01:46:56Z")
Hi all, I just created a fresh v3 rack in AWS. I’m trying to pass along the true external client IP to my application, but it looks like that data is being stripped somewhere along the way. Here’s the raw HTTP request … --- ## [Nginx 502 Bad Gateway auth0 nextjs](https://community.convox.com/t/nginx-502-bad-gateway-auth0-nextjs/889)
**Author:** [@rhys](https://community.convox.com/u/rhys)\ **Replies:** 5\ **Last updated:** [November 2, 2022, 11:10am UTC](https://community.convox.com/t/nginx-502-bad-gateway-auth0-nextjs/889 "2022-11-02T11:10:11Z")
I have a nextjs app that I want to move from vercel to convox. Unfortunately, the auth0 login doesn’t work. I get “502 Bad Gateway” Looking in nextjs-auth0 issues and other non-nextjs specfic problems, I think this is … --- ## [GCP Rack Issues](https://community.convox.com/t/gcp-rack-issues/900)
**Author:** [@Nick-Convox](https://community.convox.com/u/Nick-Convox)\ **Replies:** 0\ **Last updated:** [November 4, 2022, 3:24pm UTC](https://community.convox.com/t/gcp-rack-issues/900 "2022-11-04T15:24:04Z")
Hello everyone, I wanted to provide an update regarding the recent issues with GCP racks. Currently GCP racks are having issues with deployment due to the k8s 1.22 requirement. Our development team has been working on… --- ## [Getting 502 Bad Gateway errors for one page on v3 rack. App responds with 200, and the page works fine on v2 rack](https://community.convox.com/t/getting-502-bad-gateway-errors-for-one-page-on-v3-rack-app-responds-with-200-and-the-page-works-fine-on-v2-rack/841)
**Author:** [@nathan.f77](https://community.convox.com/u/nathan.f77)\ **Replies:** 5\ **Last updated:** [September 29, 2022, 8:09pm UTC](https://community.convox.com/t/getting-502-bad-gateway-errors-for-one-page-on-v3-rack-app-responds-with-200-and-the-page-works-fine-on-v2-rack/841 "2022-09-29T20:09:22Z")
I’ve almost completed the v2 =\> v3 upgrade, but now I’m stuck on one last problem. Convox / K8s is returning a 502 error for my app’s homepage (and only the homepage.) Everything else works fine and returns 200 response … --- ## [Deployments failing on v3 Racks](https://community.convox.com/t/deployments-failing-on-v3-racks/895)
**Author:** [@mark](https://community.convox.com/u/mark)\ **Replies:** 1\ **Last updated:** [September 28, 2022, 5:18pm UTC](https://community.convox.com/t/deployments-failing-on-v3-racks/895 "2022-09-28T17:18:28Z")
We’ve suddenly started to see deployments fail on V3 racks… I am seeing the following error if I run the deploy locally. Uploading source... ERROR: WebIdentityErr: failed to retrieve credentials caused by: InvalidIdent… --- ## [Proxy Protocol support breaks communication between apps in the same Rack](https://community.convox.com/t/proxy-protocol-support-breaks-communication-between-apps-in-the-same-rack/894)
**Author:** [@mark](https://community.convox.com/u/mark)\ **Replies:** 0\ **Last updated:** [September 8, 2022, 9:48pm UTC](https://community.convox.com/t/proxy-protocol-support-breaks-communication-between-apps-in-the-same-rack/894 "2022-09-08T21:48:14Z")
If you turn on proxy protocol support two apps in the same rack can no longer communicate with each other unless they manually set proxy protocol headers on their own requests. The NGiNX ingress/load balancer that route… --- ## [Any plans to target Oracle (OCI)?](https://community.convox.com/t/any-plans-to-target-oracle-oci/890)
**Author:** [@jake](https://community.convox.com/u/jake)\ **Replies:** 0\ **Last updated:** [August 8, 2022, 1:29am UTC](https://community.convox.com/t/any-plans-to-target-oracle-oci/890 "2022-08-08T01:29:35Z")
Curious if there are any plans to add another provider? --- ## [Problem updating rack - ERROR: json: cannot unmarshal array into Go value of type struct { Releases \[\]struct { Draft bool "json:\\"draft\\""; Prerelease bool "json:\\"prerelease\\""; Tag string "json:\\"tag\_name\\"" } }](https://community.convox.com/t/problem-updating-rack-error-json-cannot-unmarshal-array-into-go-value-of-type-struct-releases-struct-draft-bool-json-draft-prerelease-bool-json-prerelease-tag-string-json-tag-name/877)
**Author:** [@nathan.f77](https://community.convox.com/u/nathan.f77)\ **Replies:** 1\ **Last updated:** [April 4, 2022, 2:07pm UTC](https://community.convox.com/t/problem-updating-rack-error-json-cannot-unmarshal-array-into-go-value-of-type-struct-releases-struct-draft-bool-json-draft-prerelease-bool-json-prerelease-tag-string-json-tag-name/877 "2022-04-04T14:07:21Z")
Hello, I’m getting this error when I run convox rack update: $ convox rack update ERROR: json: cannot unmarshal array into Go value of type struct { Releases \[\]struct { Draft bool "json:\\"draft\\""; Prerelease bool "json… --- ## [Request to fix the terraform config so that it doesn't keep changing kubernetes\_deployment.api.spec.template.spec.priority\_class\_name every time](https://community.convox.com/t/request-to-fix-the-terraform-config-so-that-it-doesnt-keep-changing-kubernetes-deployment-api-spec-template-spec-priority-class-name-every-time/878)
**Author:** [@nathan.f77](https://community.convox.com/u/nathan.f77)\ **Replies:** 0\ **Last updated:** [April 4, 2022, 3:17am UTC](https://community.convox.com/t/request-to-fix-the-terraform-config-so-that-it-doesnt-keep-changing-kubernetes-deployment-api-spec-template-spec-priority-class-name-every-time/878 "2022-04-04T03:17:06Z")
I’ve been manually updating the Terraform config to add RDS, Elasticache, and S3 resources. Every time I run terraform apply, I see the following changes: Terraform used the selected providers to generate the following… --- ## [How to fix unhealthy pods and pending instances?](https://community.convox.com/t/how-to-fix-unhealthy-pods-and-pending-instances/874)
**Author:** [@nathan.f77](https://community.convox.com/u/nathan.f77)\ **Replies:** 3\ **Last updated:** [March 21, 2022, 2:01am UTC](https://community.convox.com/t/how-to-fix-unhealthy-pods-and-pending-instances/874 "2022-03-21T02:01:18Z")
Hello, I’ve been running a v3 rack in production for the last few months, and I’ve just noticed that I have a lot of unhealthy pods and pending instances: $ convox ps ID SERVICE STATUS RELEASE… --- ## [Trouble with running rack locally](https://community.convox.com/t/trouble-with-running-rack-locally/862)
**Author:** [@alex](https://community.convox.com/u/alex)\ **Replies:** 1\ **Last updated:** [March 17, 2022, 3:18pm UTC](https://community.convox.com/t/trouble-with-running-rack-locally/862 "2022-03-17T15:18:20Z")
I use convox cli to running rack locally convox rack install local dev Logs: ....... module.system.module.rack.module.api.module.k8s.kubernetes\_deployment.atom: Still creating... \[9m40s elapsed\] module.system.module.r… --- ## [\[RESOLVED\] Build pods being kicked The node was low on resource: ephemeral-storage](https://community.convox.com/t/resolved-build-pods-being-kicked-the-node-was-low-on-resource-ephemeral-storage/876)
**Author:** [@rhys](https://community.convox.com/u/rhys)\ **Replies:** 1\ **Last updated:** [March 16, 2022, 7:39am UTC](https://community.convox.com/t/resolved-build-pods-being-kicked-the-node-was-low-on-resource-ephemeral-storage/876 "2022-03-16T07:39:55Z")
None of my builds are finishing on my production rack. When i try to build, my build pods are being kicked part way through with this error. The node was low on resource: ephemeral-storage. Container XXXX was using 318… --- ## [Purge old builds from storage](https://community.convox.com/t/purge-old-builds-from-storage/865)
**Author:** [@user4](https://community.convox.com/u/user4)\ **Replies:** 0\ **Last updated:** [February 22, 2022, 9:42pm UTC](https://community.convox.com/t/purge-old-builds-from-storage/865 "2022-02-22T21:42:22Z")
Hello, I noticed a bucket (in my case the storage is aws s3) that contains builds, and (obviously) it is growing at every deploy. Is there a way to purge old builds maybe only those “older than” a given date ? Should … --- ## [Deploying rack into existing AWS VPC](https://community.convox.com/t/deploying-rack-into-existing-aws-vpc/824)
**Author:** [@FrankS](https://community.convox.com/u/FrankS)\ **Replies:** 3\ **Last updated:** [February 2, 2022, 10:40am UTC](https://community.convox.com/t/deploying-rack-into-existing-aws-vpc/824 "2022-02-02T10:40:10Z")
@ed\_convox is there any way to deploy a v3 rack into an existing VPC with a VPCid and specify existing subnets to use? --- ## [Azure rack deploy failing in CLI and Console](https://community.convox.com/t/azure-rack-deploy-failing-in-cli-and-console/861)
**Author:** [@user6](https://community.convox.com/u/user6)\ **Replies:** 1\ **Last updated:** [January 14, 2022, 6:50pm UTC](https://community.convox.com/t/azure-rack-deploy-failing-in-cli-and-console/861 "2022-01-14T18:50:19Z")
Using Convox on a Visual Studio Enterprise Subscription either from the CLI or the Console I get this error in the terraform when creating a rack for the first time (default out of the box). I’m unable to make any furth… --- ## [DigitalOcean SFO2 region invalid](https://community.convox.com/t/digitalocean-sfo2-region-invalid/860)
**Author:** [@user3](https://community.convox.com/u/user3)\ **Replies:** 0\ **Last updated:** [December 20, 2021, 1:25am UTC](https://community.convox.com/t/digitalocean-sfo2-region-invalid/860 "2021-12-20T01:25:25Z")
Getting an “invalid region” error creating a rack in the SFO2 region for a DigitalOcean integration. What’s up with that? It seems like the us-west-1 region for AWS is also completely broken. Why the west-coast hate? Why… [Next page](https://community.convox.com/c/rack-v3/16.md?page=1)