Overview
Product Information on Portkey
What is Portkey?
Portkey Pricing
Portkey Product Images
Overall experience with Portkey
“Portkey Enhances LLM Observatory, Guardrails, Security, and Cost Management Significantly”
“Exploring Impressions on the Product's Innovative Level”
About Company
Company Description
With Portkey's AI Gateway, Guardrails, and Observability Suite, thousands of teams ship reliable, cost-efficient, and fast Gen AI apps.
Company Details
Do You Manage Peer Insights at Portkey?
Access Vendor Portal to update and manage your profile.
Key Insights
A Snapshot of What Matters - Based on Validated User Reviews
Reviewer Insights for: Portkey
Deciding Factors: Portkey Vs. Market Average
Performance of Portkey Across Market Features
Portkey Likes & Dislikes
- Observability - the ability to see the details of prompts, responses, latency, user info, etc. - Guardrails - ability to prevent PII, toxicity, bias, etc. - Cost Management - setting rate/budget limits, seeing what each call/app is costing - Redundancy/Failover - allowing retry logic or to failover to another LLM provider if one is available without any code change - Model agnostic development - being able to change LLMs on the back-end of the application without having to change any code.
load balancer auditing fancy dashboard
Love the loadbalancer feature and how we can register different replicas of LLMs serving using different URLs on the application seamlessly. It basically acts as a middleware which monitors and serves the traffic going through internal services
It's hard to find much to dislike, but if I had to really pick Portkey apart I would say: - Constant changing - because of the AI landscape changing right now, Portkey has to try to keep up with new processes/platforms/features. Because of this, the product seems to have updates almost every other day. -Workspace level security settings - at the time of writing this, there is only org level security settings. It would be nice to be able to assign these at a workspace level
going beyond the unique POV of product. version control missing of IaC code capability
The roles for access could be more granular to setup access for different contributors on the team - more like a suggestion but it still works great in our current case.
Top Portkey Alternatives
Peer Discussions
Portkey Reviews and Ratings
- IT Manager50M-1B USDIT ServicesReview Source
Portkey Enhances LLM Observatory, Guardrails, Security, and Cost Management Significantly
Portkey has been a crucial part of our success with LLM observability, guardrails, and cost management. The Portkey team has also been there every step of the way to make sure our implementation was successful and met our needs. Not only was the implementation smooth, but if we did find ourselves with questions, the Portkey team was very responsive and eager to help support us. Now that we are in production with Portkey we are seeing the true value of the product for not only our original needs (LLM observability, guardrails, and cost management), but also for other aspects such as model agnostic development and analytic insights to how the application is being used by users. - VP, Engineering<50M USDSoftwareReview Source
Portkey Assists Adaptation of LLM Gateway for Enhanced Internal Monitoring
Portkey team is very responsive and helped us adapt the LLM gateway for our internal usage and monitoring of LLM serving services. It has a reasonable pricing structure and is now one of our core components use for services. - Senior Manager1B-10B USDSoftwareReview Source
PortKey: Enhancing Control, Security, and Scalability in AI-Driven Apps
I am completely satisfied with PortKey and its team members in the development and deployment of AI endpoints for our AI-based applications. PortKey offers a suite of tools to enhance our:- 1. Control like Configs and Guardrails 2. Observability like Analytics for Usage, Tokens, Cost, Metrics, etc 3. Security and Scalability by deploying it in your own cloud in different geo locations, SCIM, etc And yet everything can be managed from a single portal. - Principal AI Architect10B+ USDRetailReview Source
Lightweight and Rich: Key Characteristics of Portkey's Popular Design
The ability to deliver supreme customer experience and engage with customer based on their needs and cadence is something the Portkey team has mastered and excels in. Their focus on attention to details and willingness to address concerns with the customers is truly exceptional and most importantly their openness to accept feedback. - Software Engineer50M-1B USDSoftwareReview Source
Portkey's Multiplexing Ability Protects User Experience During Outages
Overall experience has been great with Portkey. It has been a saviour at times when some of the LLM providers are down, helping us multiplex between other providers/infrastructure and preventing users from seeing errors. The team has been supportive too in listening to feedback and helping us with smooth deployments.