Skip to main content

FAQs

General​

How should I refer to Connect in a blog post or social media?​

Connect is the name of the project. If that's ambiguous in your context or search ranking/uniqueness is important, please use Connect RPC.

How do I get the OpenAPI spec for the Connect APIs?​

Connect RPCs are defined using Protobuf, which serves as the specification and documentation. OpenAPI is meant for REST/HTTP endpoints and doesn't apply to RPC systems like Connect.

The Connect protocol​

Where can I find Connect implementations?​

All implementations are listed at the main Connect RPC repository.

Is there a way to generate REST paths with Connect?​

The path is simply the fully qualified name of the service. There is no built-in option to modify this path, because it would break compatibility with gRPC and gRPC-Web.

If you want more control over the path, one option would be to use gRPC Transcoding, which allows you to specify REST paths. You could use vanguard-go or the gRPC-Gateway to serve it.

Can Connect use HTTP/3?​

Yes, although not all Connect implementations have HTTP/3 support. For example, you can implement it for Connect Go by using the quic-go package for the server and client.

Why special-case unary RPCs?​

The Connect protocol is effectively two protocols, one for unary RPC and one for streaming. This isn't intellectually satisfying — it would be purer to treat unary RPCs as a bidirectional stream with exactly one message sent in each direction. In practice, we've found the loss of purity well worth it. By using standard HTTP compression negotiation and eliminating binary framing from the body, the Connect protocol lets us make unary RPCs with web browsers, cURL, or any other HTTP client.

How do I use the Connect protocol to call existing gRPC servers?​

Most Connect implementations support the gRPC protocol, so you have a choice:

  • Use the Connect runtime, but configure your client to use the gRPC protocol, or
  • Use the Connect runtime and Connect protocol, and have Envoy automatically handle the Connect-to-gRPC translation. Envoy is a popular and widely used proxy.

Envoy v1.26 ships with a Connect-gRPC bridge that allows clients to speak the Connect protocol (including GET requests) to existing gRPC servers. You can find a demo here: https://github.com/connectrpc/envoy-demo

How do I reliably call a server streaming RPC from a web browser?​

The answer is highly dependent on all of the networking parties involved. Generally, make sure that your server or your infrastructure does not apply timeouts within the expected duration of calls. If possible, pre-empt timeouts by setting short deadlines and by repeating the call when the deadline is exceeded. Read the streaming docs for the Go implementation to get an idea of the implications.

How do I proxy the Connect protocol through NGINX?​

Request-response (unary) RPCs made with the Connect protocol don't require end-to-end HTTP/2, so they can be proxied through NGINX. Streaming RPCs typically require end-to-end HTTP/2, which NGINX doesn't support. Rather than NGINX, we recommend using Envoy, Apache, or TCP-level load balancers like HAProxy, all of which support the full Connect protocol.

Do half duplex streams have a unary and streaming component?​

No. Half duplex, server streaming and client streaming, are both defined by the streaming RPC behaviour. Messages will be encoded in the connect streaming wire semantics as an enveloped message for both the request and response.

Why not use HTTP status codes?​

Every taxonomy of errors is flawed, but at least HTTP status codes are time-tested and widely understood. In a perfect world, we'd have used HTTP status codes as-is for the Connect protocol. Unfortunately, we want Connect handlers and clients to support the gRPC wire protocols without code changes. Since the mapping between gRPC and HTTP status codes is lossy, we can't provide an acceptable gRPC experience without adopting the same set of codes. C'est la vie.

Why not use the Twirp protocol?​

We really like Twirp's protocol! It's simple, doesn't rely on any HTTP/2-specific framing, and works nicely with general-purpose HTTP tools. Unfortunately, it didn't fit our needs:

  • It doesn't support streaming RPCs. Even if most RPCs are unary, many organizations have a handful of APIs that do benefit from streaming.
  • It's semantically incompatible with gRPC. Because Twirp doesn't specify how to encode timeouts and uses a very different error model, swapping protocols requires significant code changes.

In the end, we prioritized gRPC and gRPC-Web compatibility over Twirp support. We hope that Connect's unary protocol captures most of Twirp's magic while still allowing your code to interoperate with the larger gRPC ecosystem.

Does Connect RPC support Envoy?​

Yes, it offers Envoy support in several ways:

My web request fails but the response looks valid. Why isn't it going through?​

Web requests that attempt to load resources from a domain outside the domain of the page require you to configure Cross-Origin Resource Sharing (CORS). Not doing so may cause protocol errors like "missing trailer", etc. If the response is valid and the request is to a different domain, make sure the server has the correct CORS configuration.

Why does my Web client not receive the error code from my server?​

Most of the time, it's because the CORS setup of the server is incomplete. It's not enough to allow request origin, methods, and headers—you also have to to expose response headers. See the CORS documentation for details.

Why does the network explorer in the browser show strange characters in payload?​

The Protobuf binary format is efficient, but can't be rendered as text by the browser. If you use a Connect-ES client, you can switch to JSON with the transport option useBinaryFormat: false to make troubleshooting easier. Unary RPCs use pure JSON payloads with the Connect protocol.

Serialization & compression​

Why are numbers serialized as strings in JSON?​

JavaScript's Number is an IEEE 754 double-precision float: even though it occupies 64 bits of memory, some of the space is reserved for the fractional portion of the number. There's just not enough space left to represent 64-bit integers! To make absolutely sure that integers are handled correctly, the Protobuf JSON mapping represents the int64, fixed64, and uint64 types as strings.

This only affects calls made with cURL, the browser's fetch API, or other plain HTTP tools. Connect clients automatically convert numeric values to and from strings.

Why are unknown JSON fields ignored?​

Following the proto3 language guide, a JSON parser should reject unknown fields by default. However, we found the behavior to be impractical for RPC because it means that the schema cannot evolve without breaking existing clients: simply adding a field to a response will break old clients. Therefore, Connect clients and servers will ignore unknown fields, provided that the underlying implementation allows us to do so.

Go​

Why use generics?​

Generic code is inherently more complex than non-generic code. Still, introducing generics to Connect-Go eliminated two significant sources of complexity:

  • Generics let us generate less code, especially for streaming RPCs — if you're willing to write out some long URLs, it's now just as easy to use Connect without protoc-gen-connect-go. The generic stream types, like BidirectionalStream, are much clearer than the equivalent code generation templates.
  • We don't need to attach any values to the context, because Connect's generic Request and Response structs can carry headers and trailers explicitly. This makes data flow obvious and avoids any confusion about inbound and outbound metadata.

On balance, we find Connect-Go simpler with generics.

Why generate Connect-specific packages?​

If you're familiar with Protobuf, you may have noticed that protoc-gen-connect-go behaves a little differently from many other plugins: rather than adding code alongside the basic message types, it creates a separate, Connect-specific Go package and imports the base types.

This serves a few purposes:

  • It keeps the base types lightweight, so every package that works with Protobuf messages doesn't drag along an RPC framework.
  • It avoids name collisions. Many Protobuf plugins — including protoc-gen-go-grpc — generate code alongside the base types, so the package namespace becomes very crowded.
  • It keeps the contents of the base types package constant. This isn't critical when generating code locally, but it's critical to making generated SDKs and remote plugins work.

Can Connect-Go clients be used in browser applications with WASM?​

It's technically possible, but please be aware that the WASM in Go is quite new, and the architecture has some fundamental limitations that may be surprising. We encourage you to give it a try and report any issues you find to Go or Connect-Go to help bring WASM in Go forward.

Why am I seeing a "stream error: stream ID 5; INTERNAL_ERROR; received from peer" error message after X seconds?​

It means that your http.Server has a ReadTimeout or WriteTimeout field configured. These fields apply to the entire operation duration, even for streaming calls. If an operation takes longer than the value specified, the server closes the stream and clients can see the above error message. The other timeout fields won't cause this error, and we encourage you to set ReadHeaderTimeout in particular.

How do I close a client response stream in Connect-Go?​

On reading the response, a client can call CloseResponse on bidirectional streams or Close on server streams to gracefully close the connection. This will discard any remaining messages sent from the server until the final status message is received. If the status is an error, the close function will return the wire error. Alternatively, if you wish to cancel the operation and immediately stop the client stream, see below to cancel the operation.

How do I cancel a client response stream in Connect-Go?​

To cancel and abort a stream, call the cancel function of the underlying context associated with the stream. This context is provided on stream creation. On cancel, the stream is aborted and any resources are released along with it.

My project is in Go using Buf and the BSR, and now we need to generate JavaScript stubs. How should this project be structured?​

If your project implements a service, a common approach is to keep the Protobuf files in the same repository as the server implementation, and automatically push the schema to the BSR. Other repositories can then take full advantage of generated SDKs for clients, and don't need to maintain Protobuf plugins or even the Buf CLI.

For a simple example, you could take a look at the examples-go repository, which defines the Eliza service (a simple chat bot) and implements a server. The server is deployed to https://demo.connectrpc.com/, and the schema in the proto directory is pushed to buf.build/connectrpc/eliza on the BSR. It also includes a JavaScript client app hosted as a demo on the home page (you can type some text to chat with the Go server). The source for the demo is public as well, so you can look at the client. The interesting bit is that we simply import from a generated SDK on the client side:

import { ElizaService } from "@buf/connectrpc_eliza.connectrpc_es/connectrpc/eliza/v1/eliza_connect";

Does Connect-Go provide the equivalent of gRPC's WithBlock option when connecting to servers?​

No, because under the hood Connect-Go is just using an *http.Client, but we are evaluating potentially adding similar functionality to Connect-Go. In the meantime, you can take a look at [github.com/bufbuild/httplb]. It's an *http.Client that's not specific to Connect, but solves a lot of the gotchas with using the stdlib client/transport for RPC, especially if you're using k8s. Keep in mind that it's still in Alpha so the APIs are unstable, but it's important, so we're continuing to work on it.

Can the Connect protocol be disabled on the server in Connect-Go?​

It's currently not a supported option. As a workaround for now, you can inspect the content type to classify the request as a grpc/grpcWeb request and return a 415 Unsupported Media Type status otherwise. Here is an example in HTTP middleware:

func grpcOnlyMiddleware(next http.Handler) http.Handler {
	return http.HandlerFunc(func(w http.ResponseWriter, r *http.Request) {
		if !strings.HasPrefix(r.Header.Get("Content-Type"), "application/grpc") {
			w.WriteHeader(http.StatusUnsupportedMediaType)
			return
		}
		next.ServeHTTP(w, r)
	})
}

How do I customize serialization errors returned by the Connect server?​

You can customize the error message by providing a different Codec. Code and details can't be customized.

How do I use custom JSON options like EmitUnpopulated in Connect-Go?​

You can use these options by customizing the codec. https://github.com/akshayjshah/connectproto is a handy project that makes this easier.

Should graceful shutdown of streaming endpoints be manually handled in Connect-go?​

Yes. The http.Server.Shutdown method documentation has a special note about this:

Shutdown does not attempt to close nor wait for hijacked connections such as WebSockets. The caller of Shutdown should separately notify such long-lived connections of shutdown and wait for them to close, if desired. See Server.RegisterOnShutdown for a way to register shutdown notification functions.

The same principle applies to gRPC streams. In your handlers, you could listen for the request context and another global server context when waiting on streams. If your Server.RegisterOnShutdown() method cancelled that global server context, then all of your handlers would know that the request should be completed soon because of a server shutdown.

To reiterate, Shutdown() does not cancel all of the request contexts. Instead it stops accepting new connections while letting the existing requests finish normally—shutting down "gracefully".

How do I import types for google.protobuf.Any?​

Types not declared from the service's methods may need to be specified to ensure availability This often appears as a google.protobuf.Any failing to unmarshal with an unknown type error. To ensure the message can be used, add the type to the descriptor registry for your languages' runtimes.

The most pragmatic approach is to use the global type registry and import the generated Protobuf message using a blank import. For example, given a generated file proto/path/mytype.pb.go, add a Go import as import _ proto/path/mytype.pb.go to your Go application to ensure the type is registered.

For types only available at runtime, please see the protoregistry docs to add messages dynamically.

TypeScript and JavaScript​

Why do I need a proxy to call gRPC backends?​

The HTTP protocol specification has included trailers for decades. In practice, they were rarely used. Many HTTP implementations — including web browsers — still don't support trailers.

Unfortunately, gRPC makes extensive use of HTTP trailers. Because browsers don't support trailers, no code running in a browser can speak the gRPC protocol. To work around this, the gRPC team introduced the gRPC-Web protocol, which encodes trailers at the end of the response body.

Some gRPC servers (including those built with Connect-Go) support the gRPC-Web protocol natively, so browsers can communicate directly with your backend. Most of Google's gRPC implementations don't support gRPC-Web, so you must run a proxy like Envoy to translate to and from the standard gRPC protocol.

Is streaming supported?​

The Connect protocol supports all types of streaming RPCs, but web browsers have some limitations with regard to client streaming. See the Connect for Web section for details.

Does generated code affect bundle size?​

Yes, generated code does affect bundle size, but the browser implementation is a slim library using standard Web APIs, and deliberately generates very little code. For an ELIZA client, the compressed bundle size is just around 13KiB.

How does Connect compare to gRPC-web?​

With Connect, you don't need a proxy to provide your gRPC service as gRPC-web, and TypeScript is supported out of the box. Requests are easy to inspect in the browser, because the JSON format is used by default, where gRPC-web only supports the binary format.

That said, Connect ships with support for the gRPC-web protocol and is fully compatible with existing gRPC-web backends. See Choosing a protocol.

What Protobuf runtime does Connect use for TypeScript?​

Connect uses the Protobuf runtime provided by Protobuf-ES. Additionally, the code generator plugin used by Connect-ES is based on the plugin framework also provided by Protobuf-ES. For any questions you may have about this library, visit the Protobuf-ES FAQ page.

How do I add types to the descriptor registry for JavaScript?​

If a RPC in your schema uses google.protobuf.Any in a request or response message, you can provide a type registry so that they can be parsed from or serialized to JSON. See this GitHub discussion for a detailed explanation and an example.

Every service method on the server receives the HandlerContext as the second argument, which provides access to response headers. You can set cookies with the Set-Cookie response header—for example:

ctx.responseHeader.append("Set-Cookie", "foo=bar; Max=Age=120")

Deployment​

How do I handle Authorization Bearer headers through middleware/interceptors?​

See https://github.com/connectrpc/authn-go.

How do I use an interceptor to configure CORS?​

Interceptors can't be used to configure CORS. CORS is a security feature of the browsers and involves OPTIONS requests. OPTIONS requests can't be matched as RPC requests, and so interceptors can't be used to configure CORS. It's purely an HTTP concern. Both Connect-Go and connect-es have docs that show how to configure CORS for their respective HTTP libraries.

How does vanguard-go integrate with Connect interceptors?​

A Connect-Go handler wrapped with Vanguard can use Connect-Go interceptors like any other Connect-Go handler, whether the incoming request is REST or one of the supported protocols. Connect-Go interceptors cannot be applied to gRPC handlers or proxy handlers. Use gRPC interceptors or net/http middleware instead.

Missing trailers with Ambassador​

If you're using Ambassador for Kubernetes ingress and seeing "server closed the stream without sending trailers" errors, you may have overlapping gRPC and HTTP mappings for your backend services. You can work around this problem using the cluster_tag property, as described in emissary-ingress/emissary#3112.

HTTP 464 error with AWS​

If you're using the AWS Application Load Balancer support for gRPC, you will likely see an HTTP error response with code 464 for a Connect GET request, or for a web browser making a CORS preflight OPTIONS request. The reason for this behavior is that target groups with "protocol version" set to "gRPC" only accept POST requests. See the troubleshooting document for reference.

As a simple solution, you can configure the target group to use "HTTP2" instead. It will support Connect as well as gRPC - you will only give up support for the gRPC-specific add-on features.

In case you do need the gRPC-specific add-ons, you can use two target groups: Route HTTP GET requests and anything with the application/proto, application/json, application/connect+proto, or application/connect+json Content-Types to the HTTP2 target group. Route anything else to the gRPC target group.

How do I send metrics to Prometheus in Connect-Go?​

Connect has support package for OpenTelemetry: https://pkg.go.dev/connectrpc.com/otelconnect. Prometheus can be configured as an exporter.