LLM Api #9722
LLM Api #9722
Conversation
| @@ -293,6 +293,9 @@ message TransformationTemplate { | |||
| // If you want to nest elements inside the body, use dot separator in the | |||
| // extractor name. | |||
| MergeExtractorsToBody merge_extractors_to_body = 6; | |||
| // A list of keys to merge into the JSON body. If the key already exists in | |||
| // the body it will be overwritten. | |||
There was a problem hiding this comment.
What is keys referring to here in the context of a request/response body?
There was a problem hiding this comment.
This isn't user-facing config, internal to our filter.
| } | ||
|
|
||
|
|
||
| message Redis { |
There was a problem hiding this comment.
Similar comment as Postgres, perhaps nest this under semantic_cache.datastore
There was a problem hiding this comment.
I agree the use-case here is probably only for semantic caching, I will move it
|
Visit the preview URL for this PR (updated for commit cae11ac): https://gloo-edge--pr9722-eitanya-ai-gateway-l1jpyx94.web.app (expires Tue, 23 Jul 2024 13:43:23 GMT) 🔥 via Firebase Hosting GitHub Action 🌎 Sign: 77c2b86e287749579b7ff9cadb81e099042ef677 |
…into eitanya/ai-gateway
…into eitanya/ai-gateway
…into eitanya/ai-gateway
|
Issues linked to changelog: |
This PR introduces the new API for the LLM focused functionality in Gloo Gateway