View and Download Peer Insights About
What Your Peers Are Saying About
VP of Product Management
Based on many peer discussions, seemed like GitHub Co-pilot was really the only true AI product teams were using internally. Any other tools people are finding value with on internal side?
Senior Vice President, Engineering
Other than GitHub Copilot, we have seen developers using Tabnine and Codeium very often with a lot of success. If you are an IntelliJ fan, do check out their custom AI available in their tools like Rover and Fleet.  ChatGPT has been a revolution and probably is as good as any other option available today. Feel free to checkout these tools though.
See Full Discussion
16 Nov 20234.4k Views8 Comments
IT Manager
Has anyone had any success with evaluating the impact of using Generative AI tools such as GitHub's Copilot on the productivity or performance impact on developers? I see a lot of qualitative discussions about how developers say they are more productive, but how are you measuring that impact?
Chief of DevOps and Partner
Here is a link to a study where they recruited 95 professional developers, split them randomly into two groups, and timed how long it took them to write an HTTP server in JavaScript. Research: quantifying GitHub Copilot’s impact on developer productivity and happiness - The GitHub Blog Result:  The group that used GitHub Copilot had a higher rate of completing the task (78%, compared to 70% in the group without Copilot). The striking difference was that developers who used GitHub Copilot completed the task significantly faster–55% faster than the developers who didn’t use GitHub Copilot. Specifically, the developers using GitHub Copilot took on average 1 hour and 11 minutes to complete the task, while the developers who didn’t use GitHub Copilot took on average 2 hours and 41 minutes. These results are statistically significant (P=.0017) and the 95% confidence interval for the percentage speed gain is [21%, 89%].
See Full Discussion
11 Jul 202543.3k Views16 Comments