Skip to content
J·BJon BishopIndependent growth marketer

A curated scientific evidence directory

Developer experience studies

Explore peer-reviewed field experiments and meta-analyses on SaaS trials, email, paid search, referrals, content sharing and choice design. Compare methods, context and limits.

715 studies19 topics

150 studies match your filters

Clear filters
Developer experiencePlatforms
Study strength: 2/5

Sustaining Superior Performance in Business Ecosystems: Evidence from Application Software Developers in the iOS and Android Smartphone Ecosystems

Organization Science · 2017

For your marketing

Use this paper as evidence about sustaining superior performance in business ecosystems: evidence from application software developers in the ios and android smartphone ecosystems in the stated context; compare its population, treatment and outcome with your own decision.

Summary

Higher ecosystem complexity helped developers sustain superior performance, especially experienced firms; platform transitions made sustained superiority harder, with the adverse effect amplified by complexity.

Developer experiencePlatforms
Study strength: 2/5

Third-party mobile app developers’ continued participation in platform-centric ecosystems: An empirical investigation of two different mechanisms

International Journal of Information Management · 2016

For your marketing

Use this study as a bounded example related to third-party mobile app developers’ continued participation in platform-centric ecosystems: an empirical investigation of two different mechanisms; evaluate whether its customers, intervention and outcome match your own context.

Summary

The study identifies and empirically investigates two contrasting routes to continued participation: genuine desire/dedication and need/constraint; it argues platform owners must manage the exchange relationship from developers' perspective to retain them.

Developer experienceProduct adoption
Study strength: 3.5/5

On the adoption of software bill of materials in open-source software projects

Journal of Systems and Software · 2025

For your marketing

Treat this as evidence for the specific marketing capability and growth question studied. Compare the setting and sample to your company before changing a growth decision; use a local experiment where the paper does not match your context.

Summary

SBOM adoption is low but rising. SBOMs are mostly generated through build-integration tools or GitHub Actions; fewer than half of analyzed projects include them in version control or public release artifacts. Only a limited fraction contain minimum/recommended information, and some are noncompliant with existing SBOM standards. For a founder, use this as a question to test in your own context, not a universal playbook.

Developer experienceProduct adoption
Study strength: 2.5/5

Factors influencing free and open-source software adoption in developing countries—an empirical study

Journal of Open Innovation: Technology, Market, and Complexity · 2023

For your marketing

Treat this as evidence for the specific marketing capability and growth question studied. Compare the setting and sample to your company before changing a growth decision; use a local experiment where the paper does not match your context.

Summary

The abstract reports significant relationships between FOSS adoption and low cost, performance expectation, social influence, and system quality; safety/security, interoperability, and usability are described as especially important in adoption decisions. The paper proposes a new adoption model. For a founder, use this as a question to test in your own context, not a universal playbook.

Developer experienceProduct adoption
Study strength: 3.5/5

Beyond Code Generation: An Observational Study of ChatGPT Usage in Software Engineering Practice

ACM Transactions on Software Engineering and Methodology · 2024

For your marketing

Treat this as evidence for the specific customer behavior and adoption question studied. Compare the setting and sample to your company before changing a growth decision; use a local experiment where the paper does not match your context.

Summary

Practitioners more often sought guidance or learning than ready-to-use software artifacts; simple artifact generation and brainstorming were useful, complex tasks were harder; about two-thirds expressed high or moderate trust but none trusted outputs entirely, and lack of sources reduced trust. For a founder, use this as a question to test in your own context, not a universal playbook.

AIDeveloper experience
Study strength: 3.5/5

Examining the Use and Impact of an AI Code Assistant on Developer Productivity

Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · 2025

For your marketing

For developer-tool founders, measure perceived and behavioral productivity together, segment by user, and make provenance, ownership, responsibility, and output-quality workflows explicit. Avoid assuming that aggregate positive sentiment means every team or task benefits.

Summary

The assistant generally produced net perceived productivity increases, but benefits were not experienced equally; the study also surfaced motivations, expectations about speed/quality, and questions about ownership and responsibility for generated code. For a SaaS founder: For developer-tool founders, measure perceived and behavioral productivity together, segment by user, and make provenance, ownership, responsibility, and output-quality workflows explicit. Avoid assuming that aggregate positive sentiment means every team or task benefits.

Developer experience
Study strength: 3.5/5

Software developers' perceptions of productivity

Proceedings of the 22nd ACM SIGSOFT International Symposium on Foundations of Software Engineering (FSE 2014) · 2014

For your marketing

Useful for product/engineering workflow hypotheses and user research, not proof that a tool improves delivery metrics; pair perceived productivity with cycle time, quality, and wellbeing measures.

Summary

Developers perceive days as productive when completing many or large tasks without significant interruptions/context switches, although substantial task/activity switching can coexist with feeling productive. Founder-use interpretation: Useful for product/engineering workflow hypotheses and user research, not proof that a tool improves delivery metrics; pair perceived productivity with cycle time, quality, and wellbeing measures.

AIDeveloper experience
Study strength: 4.5/5

The Effects of Generative AI on High-Skilled Work: Evidence from Three Field Experiments with Software Developers

Management Science (Articles in Advance) · 2026

For your marketing

Strong evidence for testing AI-assisted engineering productivity, not a promise of proportional headcount or SaaS growth; run a controlled rollout with quality, security, rework, and customer outcomes.

Summary

Pooling the experiments, AI access increased completed tasks by 26.08% (SE 10.3%); less-experienced developers adopted more and had larger gains, while individual experiments were noisy and heterogeneous. Founder-use interpretation: Strong evidence for testing AI-assisted engineering productivity, not a promise of proportional headcount or SaaS growth; run a controlled rollout with quality, security, rework, and customer outcomes.

Buyer behaviorDeveloper experience
Study strength: 3.5/5

Impacts of License Choice and Organizational Sponsorship on User Interest and Development Activity in Open Source Software Projects

Information Systems Research · 2006

For your marketing

Use this as a question to test in your own product context, not as a universal benchmark. The publisher abstract does not provide an explicit limitations section or a causal identification strategy. Because the evidence is observational and tied to Freshmeat.net/project-home-page listings, representativeness and causal interpretation beyond those projects remain uncertain.

Summary

License restrictiveness and organizational sponsorship interacted: users were most attracted to projects sponsored by nonmarket organizations and using nonrestrictive licenses. Licensing and sponsorship also addressed complementary developer motivations, so licensing’s relationship with development activity depended on sponsor type. Founder-use interpretation: Use this as a question to test in your own product context, not as a universal benchmark. The publisher abstract does not provide an explicit limitations section or a causal identification strategy. Because the evidence is observational and tied to Freshmeat.net/project-home-page listings, representativeness and causal interpretation beyond those projects remain uncertain.

Developer experience
Study strength: 3.5/5

How Peripheral Developers Contribute to Open-Source Software Development

Information Systems Research · 2012

For your marketing

Use this as a question to test in your own product context, not as a universal benchmark. The publisher abstract does not report a dedicated limitations section. The study is observational and its sample consists of 147 open-source products, so representativeness, measurement validity, and causal interpretation beyond the sampled projects cannot be established from the publisher record alone.

Summary

Peripheral developers made significant contributions to product quality and diffusion, especially when projects were in more mature product-development stages. Founder-use interpretation: Use this as a question to test in your own product context, not as a universal benchmark. The publisher abstract does not report a dedicated limitations section. The study is observational and its sample consists of 147 open-source products, so representativeness, measurement validity, and causal interpretation beyond the sampled projects cannot be established from the publisher record alone.

Developer experience
Study strength: 4/5

Assessing open source software health in organizations’ intake processes: A qualitative study on the practitioners’ perspective

Empirical Software Engineering · 2026

For your marketing

Use risk-adjusted health intake; compare like-with-like projects and tailor metrics to organizational needs.

Summary

Synthesizes 21 health aspects and 72 metrics; relevant criteria depend on life-cycle stage, complexity, governance concentration, and strategic importance.

Developer experience
Study strength: 3.5/5

An Empirical Study on Vulnerability Disclosure Management of Open Source Software

ACM conference proceedings · 2025

For your marketing

Publish a clear vulnerability-reporting policy, triage ownership, and response expectations.

Summary

Shows disclosure management practices and preferences vary, making governance and communication central to OSS security.

Developer experience
Study strength: 4/5

Community engagement and the lifespan of open-source software projects

Information and Software Technology · 2025

For your marketing

Prioritize product value, innovation, and re-engagement—not just PR process efficiency—as survival levers.

Summary

Project death spirals show declining innovation, growing backlog, and rising merge latency; popularity and innovation predict survival more strongly than workflow friction.

AIDeveloper experience
Study strength: 3.5/5

Copiloting the future: How generative AI transforms Software Engineering

Information and Software Technology · 2025

For your marketing

Pilot AI assistance with measurement of task completion, review rework, defects, security, and learning—not speed alone.

Summary

Examines how generative AI changes software-engineering work and developer productivity.

Developer experience
Study strength: 3.5/5

Lightweight dynamic build batching algorithms for continuous integration

Empirical Software Engineering · 2025

For your marketing

Optimize CI scheduling to reduce feedback delay while preserving build fairness.

Summary

Study evaluates lightweight dynamic build-batching algorithms for continuous integration.

Developer experience
Study strength: 3.5/5

On the need to monitor continuous integration practices

Empirical Software Engineering · 2025

For your marketing

Create a small CI observability dashboard covering duration, failures, queueing, and recovery time.

Summary

Explores developer perceptions of monitoring CI practices and defines metrics associated with CI.

Developer experience
Study strength: 4/5

Public sector open source software projects—How is development organized?

Empirical Software Engineering · 2025

For your marketing

Track concentration and role overlap as bus-factor risks when building a community-led product.

Summary

Public-sector projects show concentrated roles: in OS2Forms the top five covered about 90% of commits and 75% of bug reports.

Developer experience
Study strength: 3.5/5

Developer Productivity for Humans, Part 8: Creativity in Software Engineering

IEEE Software · 2024

For your marketing

Protect exploratory time and evaluate developer tools by problem-solving quality, not only throughput.

Summary

Frames creativity as a meaningful dimension of software-engineering productivity rather than equating output with volume.

Developer experience
Study strength: 3.5/5

Does using Bazel help speed up continuous integration builds?

Empirical Software Engineering · 2024

For your marketing

Benchmark build-system migrations on representative repositories before promising speed gains.

Summary

Empirical study evaluates whether Bazel speeds continuous-integration builds.

Developer experience
Study strength: 3.5/5

Follow-Up Attention: An Empirical Study of Developer and Neural Model Code Exploration

IEEE Transactions on Software Engineering · 2024

For your marketing

Evaluate AI coding tools on downstream comprehension and navigation, not just initial suggestion acceptance.

Summary

Studies follow-up attention and code exploration behavior when developers interact with neural models.

Developer experience
Study strength: 4/5

How to Gain Commit Rights in Modern Top Open Source Communities?

ACM conference proceedings · 2024

For your marketing

Publish transparent advancement criteria and reward non-code work.

Summary

Commit rights depend on demonstrated code, review, documentation, and community participation, not only raw coding.

Developer experience
Study strength: 3.5/5

Understanding and effectively mitigating code review anxiety

Empirical Software Engineering · 2024

For your marketing

Build psychologically safe review workflows: private coaching, respectful feedback, and clear expectations.

Summary

Empirical study investigates code-review anxiety and ways to mitigate it.

Developer experience
Study strength: 3.5/5

A Human-Centered Approach to Developer Productivity

IEEE Software · 2023

For your marketing

Build product analytics around multiple dimensions—flow, collaboration, quality, and developer experience.

Summary

Study examines human, team, or interaction factors that shape perceived/productivity outcomes rather than reducing productivity to output counts.

Developer experience
Study strength: 3.5/5

Developer Productivity for Humans, Part 2: Hybrid Productivity

IEEE Software · 2023

For your marketing

Combine delivery, collaboration, and developer-experience signals when managing hybrid teams.

Summary

Examines productivity measurement when work is distributed across people, tools, and locations.

Developer experience
Study strength: 3.5/5

Does code review speed matter for practitioners?

Empirical Software Engineering · 2023

For your marketing

Measure review latency with practitioner goals and context, not as a standalone target.

Summary

Survey study examines practitioners’ beliefs and practices about whether code-review speed matters.

Developer experience
Study strength: 3.5/5

Learning to Predict Code Review Completion Time In Modern Code Review

Empirical Software Engineering · 2023

For your marketing

Surface review-time forecasts and bottleneck explanations to improve planning and routing.

Summary

Empirical study models/predicts code-review completion time in modern review workflows.

Developer experience
Study strength: 4/5

Archetypes of open-source business models

Electronic Markets · 2022

For your marketing

Compare a SaaS/open-core plan against archetypes and make value capture explicit.

Summary

Finds seven archetypes, including open-source platform, infrastructure, open-core, funding-based, and proprietary-like models.

Developer experience
Study strength: 3.5/5

How developers and managers define and trade productivity for quality

CHASE Proceedings · 2022

For your marketing

Align leaders and engineers on a balanced definition of productivity before selecting metrics or incentives.

Summary

Examines how practitioners define productivity and negotiate trade-offs between productivity and software quality.

Developer experience
Study strength: 3.5/5

Measuring Developer Productivity and the New Future of Work

15th Innovations in Software Engineering Conference · 2022

For your marketing

Build product analytics around multiple dimensions—flow, collaboration, quality, and developer experience.

Summary

Study examines human, team, or interaction factors that shape perceived/productivity outcomes rather than reducing productivity to output counts.

Developer experience
Study strength: 4/5

Opinion Mining for Software Development: A Systematic Literature Review

ACM Transactions on Software Engineering and Methodology · 2022

For your marketing

Use structured sentiment/opinion mining on issue trackers, reviews, and developer communications to prioritize product and developer-experience improvements, with validation against labeled data.

Summary

Maps software-development opinion-mining activities, methods, datasets, tool evaluations, and recurring application concerns; provides guidance for selecting and customizing tools.

Developer experience
Study strength: 3.5/5

Software Analytics of Open Source Business Software

Journal of Software Engineering and Applications · 2022

For your marketing

Use the findings to guide open-source participation, ecosystem governance, contributor incentives, and integration priorities; validate in the founder’s market.

Summary

The fetched metadata identifies this peer-reviewed work as addressing software analytics of open source business software. Detailed findings were not exposed in the fetched abstract.

Developer experience
Study strength: 3.5/5

The effects of continuous integration on software development: a systematic literature review

Empirical Software Engineering · 2022

For your marketing

Position CI features around faster feedback while measuring build cost, failures, and developer confidence.

Summary

Systematic review synthesizes empirical evidence on how continuous integration affects software development; benefits and implementation trade-offs are reported.

Developer experience
Study strength: 3.5/5

What improves developer productivity at google? code quality

ESEC/FSE Proceedings · 2022

For your marketing

Treat code quality and maintainability as productivity enablers; evaluate quality investments with longitudinal productivity data.

Summary

Investigates factors that causally improve developer productivity, with code quality as a focal factor.

Developer experience
Study strength: 3.5/5

Developers perception of peer code review in research software development

Empirical Software Engineering · 2021

For your marketing

Reduce review friction with templates, norms, and domain-aware reviewer matching.

Summary

Empirical study examines developers’ perceptions of peer code review in research software development.

Developer experience
Study strength: 4/5

On the analysis of non-coding roles in open source development

Empirical Software Engineering · 2021

For your marketing

Recognize docs, support, design, and triage as first-class contribution routes.

Summary

Finds dedicated non-coding contributors are important and OSS communities are diverse in roles.

Developer experience
Study strength: 3.5/5

Towards a Theory of Software Developer Job Satisfaction and Perceived Productivity

IEEE Transactions on Software Engineering · 2021

For your marketing

Treat developer experience and satisfaction as leading indicators alongside delivery metrics.

Summary

Study develops and tests a theory connecting software-developer job satisfaction with perceived productivity.

AIDeveloper experience
Study strength: 3.5/5

Using Machine Intelligence to Prioritise Code Review Requests

2021 IEEE/ACM 43rd International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP) · 2021

For your marketing

Use risk- and urgency-aware review queues, with human override and calibration.

Summary

Study evaluates machine-intelligence approaches for prioritizing code-review requests.

Developer experience
Study strength: 3.5/5

Why are many businesses instilling a DevOps culture into their organization?

Empirical Software Engineering · 2021

For your marketing

Sell DevOps products with adoption and culture change support, not tooling alone.

Summary

Empirical study investigates why businesses instill a DevOps culture and the organizational factors involved.

Developer experience
Study strength: 3.5/5

An empirical study of security culture in open source software communities

ACM conference proceedings · 2020

For your marketing

Create security ownership, norms, communication channels, and governance—not only technical controls.

Summary

Security culture spans attitude, behavior, competency, norms, governance, and communication; social context affects security behavior and decisions.

Developer experience
Study strength: 3.5/5

An Empirical Taxonomy of DevOps in Practice

2020 46th Euromicro Conference on Software Engineering and Advanced Applications (SEAA) · 2020

For your marketing

Help teams assess their current operating model and choose incremental DevOps capabilities.

Summary

Empirical study develops a taxonomy of DevOps in practice.

Developer experience
Study strength: 3.5/5

Continuous Conflict Prediction during Collaborative Software Development

Proceedings of the 3rd International Conference on Software Engineering and Information Management · 2020

For your marketing

Add early conflict alerts and coordination support to collaborative coding tools.

Summary

Empirical repository study investigates predicting integration conflicts during collaborative development.

Developer experience
Study strength: 3.5/5

DevOps in an ISO 13485 Regulated Environment

Proceedings of the 14th ACM / IEEE International Symposium on Empirical Software Engineering and Measurement (ESEM) · 2020

For your marketing

Build auditability, traceability, approvals, and evidence capture into delivery workflows.

Summary

Empirical studies examine how DevOps practices operate under regulated software constraints.

Developer experience
Study strength: 3.5/5

Enabling the Study of Software Development Behavior With Cross-Tool Logs

IEEE Software · 2020

For your marketing

Unify IDE, repository, review, build, and issue data before interpreting engineering productivity.

Summary

Shows how cross-tool logs can provide a richer view of software-development behavior than any single tool log.

Developer experiencePlatforms
Study strength: 3.5/5

How do companies collaborate in open source ecosystems? An empirical study of OpenStack

ACM/IEEE International Conference on Software Engineering · 2020

For your marketing

Define contribution pathways, company roles, and cross-firm governance early.

Summary

Commercial collaboration is substantial and structured across organizations rather than purely volunteer-driven.

Developer experience
Study strength: 3.5/5

Open Source Software and Firm Involvement

Innovation, Entrepreneurship und Digitalisierung · 2020

For your marketing

Use the findings to guide open-source participation, ecosystem governance, contributor incentives, and integration priorities; validate in the founder’s market.

Summary

The fetched metadata identifies this peer-reviewed work as addressing open source software and firm involvement. Detailed findings were not exposed in the fetched abstract.

Developer experience
Study strength: 4/5

Scaling open source communities: an empirical study of the Linux kernel

ACM/IEEE International Conference on Software Engineering · 2020

For your marketing

Use delegated maintainership with trust, pre-commit tests, strict review, and tooling.

Summary

A multiple-committer model reduced maintainer burden and scaled to more committers when backed by testing, review, and risk controls.

Developer experience
Study strength: 3.5/5

Software Architecture Degradation in Open Source Software: A Systematic Literature Review

IEEE Access · 2020

For your marketing

Use the study’s platform, complementor, API, ecosystem, open-source, or standards implications to guide governance, partner incentives, integration priorities, and ecosystem experimentation; validate in the founder’s market.

Summary

The fetched metadata identifies this peer-reviewed work as addressing software architecture degradation in open source software: a systematic literature review. Detailed findings were not exposed in the fetched abstract.

Developer experience
Study strength: 3.5/5

Visualizing Interaction Data Inside & Outside the IDE to Characterize Developer Productivity

2020 Working Conference on Software Visualization (VISSOFT) · 2020

For your marketing

Build product analytics around multiple dimensions—flow, collaboration, quality, and developer experience.

Summary

Study examines human, team, or interaction factors that shape perceived/productivity outcomes rather than reducing productivity to output counts.

Developer experience
Study strength: 3.5/5

Enabling Continuous Improvement of a Continuous Integration Process

2019 34th IEEE/ACM International Conference on Automated Software Engineering (ASE) · 2019

For your marketing

Provide feedback loops and experiments for pipeline reliability rather than one-off automation.

Summary

Empirical study examines mechanisms for improving a continuous-integration process over time.

Developer experience
Study strength: 3.5/5

How Team Awareness Influences Perceptions of Developer Productivity

Rethinking Productivity in Software Engineering · 2019

For your marketing

Build product analytics around multiple dimensions—flow, collaboration, quality, and developer experience.

Summary

Study examines human, team, or interaction factors that shape perceived/productivity outcomes rather than reducing productivity to output counts.

Developer experience
Study strength: 3.5/5

Software developer productivity loss due to technical debt—A replication and extension study examining developers’ development work

Journal of Systems and Software · 2019

For your marketing

Track debt as a productivity and retention risk; prioritize cleanup using developer-work and delivery evidence.

Summary

Empirical study links technical debt with loss of developer productivity/development work; replication and extension examine the relationship.

Developer experience
Study strength: 3.5/5

Tackling Build Failures in Continuous Integration

2019 34th IEEE/ACM International Conference on Automated Software Engineering (ASE) · 2019

For your marketing

Offer failure triage, flaky-test detection, ownership routing, and actionable build diagnostics.

Summary

Empirical mining study investigates patterns and causes of build failures in continuous integration.

Developer experience
Study strength: 3.5/5

Why Does Code Review Work for Open Source Software Communities?

2019 IEEE/ACM 41st International Conference on Software Engineering (ICSE) · 2019

For your marketing

Support reviewer participation, social context, and maintainability—not only automated checks.

Summary

Empirical open-source study investigates mechanisms through which code review works in community projects.

Developer experience
Study strength: 3.5/5

A large-scale study of code review and software quality

IEEE Transactions on Software Engineering · 2018

For your marketing

Segment review metrics by change type and connect them to post-release defects, not approval counts alone.

Summary

Examines the relationship between code-review practices and software quality at scale.

Developer experience
Study strength: 3.5/5

An empirical study of architecting for continuous delivery and deployment

Empirical Software Engineering · 2018

For your marketing

Include deployability, testability, and operational feedback in architecture reviews from the start.

Summary

Connects architectural practices and decisions with continuous delivery and deployment concerns.

Developer experience
Study strength: 3.5/5

Open source ERP business model framework

Robotics and Computer-Integrated Manufacturing · 2018

For your marketing

Use the study’s platform, complementor, API, ecosystem, open-source, or standards implications to guide governance, partner incentives, integration priorities, and ecosystem experimentation; validate in the founder’s market.

Summary

The fetched metadata identifies this peer-reviewed work as addressing open source erp business model framework. Detailed findings were not exposed in the fetched abstract.

Developer experience
Study strength: 3.5/5

Regulated software meets DevOps

Information and Software Technology · 2018

For your marketing

Build auditability, traceability, approvals, and evidence capture into delivery workflows.

Summary

Empirical studies examine how DevOps practices operate under regulated software constraints.

Developer experience
Study strength: 3.5/5

Technical debt cripples software developer productivity

Proceedings of the 2018 International Conference on Technical Debt · 2018

For your marketing

Track debt as a productivity and retention risk; prioritize cleanup using developer-work and delivery evidence.

Summary

Empirical study links technical debt with loss of developer productivity/development work; replication and extension examine the relationship.

Developer experience
Study strength: 3.5/5

The impact of continuous integration on other software development practices

International Conference proceedings · 2017

For your marketing

Measure CI adoption against review, testing, and issue-flow changes rather than build success alone.

Summary

Studies changes in code writing/submission, issue and pull-request closure, and testing after CI adoption.

Developer experience
Study strength: 3.5/5

Understanding Organization and Open Source Community Relations

ACM conference proceedings · 2017

For your marketing

Create an explicit boundary/liaison function between company goals and community norms.

Summary

Studies how organizational involvement shapes relationships with OSS communities.

Developer experience
Study strength: 3.5/5

Bing developer assistant: improving developer productivity by recommending sample code

Proceedings of the 2016 24th ACM SIGSOFT International Symposium on Foundations of Software Engineering · 2016

For your marketing

Use task-relevant retrieval and usage telemetry to improve coding assistance while measuring correctness.

Summary

Empirical study evaluates a developer assistant that recommends sample code to improve productivity.

Developer experience
Study strength: 3.5/5

Leveraging Biometric Data to Boost Software Developer Productivity

2016 IEEE 23rd International Conference on Software Analysis, Evolution, and Reengineering (SANER) · 2016

For your marketing

Treat passive signals as experimental complements to self-report and delivery metrics, with strong privacy safeguards.

Summary

Empirical study explores biometric/physiological data as an objective signal related to software-developer productivity.

Buyer behaviorDeveloper experiencePlatforms
Study strength: 3.5/5

Mobile Application Developers' Platform Choice Model

2016 49th Hawaii International Conference on System Sciences (HICSS) · 2016

For your marketing

Use the study’s platform, complementor, API, ecosystem, open-source, or standards implications to guide governance, partner incentives, integration priorities, and ecosystem experimentation; validate in the founder’s market.

Summary

The fetched metadata identifies this peer-reviewed work as addressing mobile application developers' platform choice model. Detailed findings were not exposed in the fetched abstract.

Developer experience
Study strength: 3.5/5

Build Waiting Time in Continuous Integration -- An Initial Interdisciplinary Literature Review

2015 IEEE/ACM 2nd International Workshop on Rapid Continuous Software Engineering · 2015

For your marketing

Position CI features around faster feedback while measuring build cost, failures, and developer confidence.

Summary

Systematic review synthesizes empirical evidence on how continuous integration affects software development; benefits and implementation trade-offs are reported.

Developer experiencePlatformsRetention
Study strength: 3.5/5

Platform Desertion by App Developers

Journal of Management Information Systems · 2015

For your marketing

Use the study’s platform, complementor, API, ecosystem, open-source, or standards implications to guide governance, partner incentives, integration priorities, and ecosystem experimentation; validate in the founder’s market.

Summary

The fetched metadata identifies this peer-reviewed work as addressing platform desertion by app developers. Detailed findings were not exposed in the fetched abstract.

Developer experience
Study strength: 3.5/5

Characteristics of the vulnerable code changes identified through peer code review

Companion Proceedings of the 36th International Conference on Software Engineering · 2014

For your marketing

Prioritize security-sensitive changes and add security-aware review assistance.

Summary

Empirical peer-review study characterizes vulnerable code changes identified through review.

Developer experience
Study strength: 3.5/5

Supporting continuous integration by mashing-up software quality information

2014 Software Evolution Week - IEEE Conference on Software Maintenance, Reengineering, and Reverse Engineering (CSMR-WCRE) · 2014

For your marketing

Integrate quality signals into CI dashboards and pull-request workflows.

Summary

Study presents and evaluates combining software-quality information to support continuous integration.

Developer experiencePlatformsProduct adoption
Study strength: 3.5/5

An Empirical Study of API Stability and Adoption in the Android Ecosystem

2013 IEEE International Conference on Software Maintenance · 2013

For your marketing

Use the study’s platform, complementor, API, ecosystem, open-source, or standards implications to guide governance, partner incentives, integration priorities, and ecosystem experimentation; validate in the founder’s market.

Summary

The fetched metadata identifies this peer-reviewed work as addressing an empirical study of api stability and adoption in the android ecosystem. Detailed findings were not exposed in the fetched abstract.

Developer experience
Study strength: 3.5/5

Mining Developer Contribution in Open Source Software Using Visualization Techniques

2013 Third International Conference on Intelligent System Design and Engineering Applications · 2013

For your marketing

Use the study’s platform, complementor, API, ecosystem, open-source, or standards implications to guide governance, partner incentives, integration priorities, and ecosystem experimentation; validate in the founder’s market.

Summary

The fetched metadata identifies this peer-reviewed work as addressing mining developer contribution in open source software using visualization techniques. Detailed findings were not exposed in the fetched abstract.

Developer experience
Study strength: 4/5

Common characteristics of open source software development and applicability for drug discovery: a systematic review

Journal of the International AIDS Society · 2011

For your marketing

When adapting open collaboration to data products, transfer mechanisms and incentives cautiously rather than copying OSS wholesale.

Summary

Synthesizes recurring OSS characteristics for application beyond software; no meta-analysis was appropriate due to heterogeneous methods and samples.

Developer experience
Study strength: 3.5/5

Developer fluency: achieving true mastery in software projects

FSE Proceedings · 2010

For your marketing

Improve onboarding with architecture maps, targeted starter tasks, and ownership-aware mentoring.

Summary

Studies how developers become fluent in projects and relates fluency to productivity.

Developer experience
Study strength: 3.5/5

Factors that Influence the Productivity of Software Developers in a Developer View

Innovations in Computing Sciences and Software Engineering · 2010

For your marketing

Build product analytics around multiple dimensions—flow, collaboration, quality, and developer experience.

Summary

Study examines human, team, or interaction factors that shape perceived/productivity outcomes rather than reducing productivity to output counts.

Developer experience
Study strength: 3.5/5

Succession: Measuring transfer of code and developer productivity

2009 IEEE 31st International Conference on Software Engineering · 2009

For your marketing

Design onboarding and ownership-transfer features around continuity, handoffs, and reviewability.

Summary

Empirical study measures transfer of code between developers and its relationship to developer productivity.

Developer experience
Study strength: 3.5/5

Automated Continuous Integration of Component-Based Software: An Industrial Experience

2008 23rd IEEE/ACM International Conference on Automated Software Engineering · 2008

For your marketing

Use the industrial lessons to scope integration automation and component-level validation.

Summary

Industrial experience reports automated continuous integration for component-based software.

Developer experience
Study strength: 3.5/5

Motivating open source software developers

Proceedings of the 2006 ACM SIGMIS CPR conference on computer personnel research: Forty four years of computer personnel research: achievements, challenges & the future · 2006

For your marketing

Use the findings to guide open-source participation, ecosystem governance, contributor incentives, and integration priorities; validate in the founder’s market.

Summary

The fetched metadata identifies this peer-reviewed work as addressing motivating open source software developers. Detailed findings were not exposed in the fetched abstract.

Developer experience
Study strength: 3.5/5

A Field Study of Developer Pairs: Productivity Impacts and Implications

IEEE Software · 2004

For your marketing

Use pair programming selectively for complex or high-risk work and evaluate throughput plus quality.

Summary

Field study evaluates productivity impacts and implications of developer pairs.

Developer experience
Study strength: 3.5/5

A three-component model of customer commitment to service providers

Journal of the Academy of Marketing Science · 2004

For your marketing

Build emotional trust and perceived partnership, not only contractual lock-in; monitor renewal reasons separately.

Summary

Affective, continuance and normative commitment are distinct; commitment is not reducible to satisfaction.

Developer experience
Study strength: 4/5

Toward an understanding of the motivation of open source software developers

Proceedings of the 25th International Conference on Software Engineering. · 2003

For your marketing

Design contribution pathways and recognition around several motives.

Summary

Participation is associated with multiple intrinsic and extrinsic motives, not only ideology.

Developer experience
Study strength: 3.5/5

From peer production to productization: A study of socially enabled business models

Proceedings of the 9th International Conference on Electronic Commerce. · 2008

For your marketing

Test open-core, support, hosting and ecosystem complements rather than monetizing code alone.

Summary

Business models can create value around open code through complementary services and ecosystem participation.

Developer experience
Study strength: 3.5/5

Sustainability of open source software communities beyond a fork

Journal of Systems and Software. · 2014

For your marketing

Plan fork-resilient governance, contributor continuity and independent infrastructure.

Summary

Community sustainability depends on governance, participation and maintaining a viable project after organizational rupture.

Developer experience
Study strength: 3.5/5

Adopters trust in enterprise open source vendors: An empirical examination

Journal of Systems and Software. · 2017

For your marketing

Invest in credibility, support, security assurances and transparent roadmaps.

Summary

Trust is an important determinant of enterprise adoption and is shaped by vendor and technology signals.

Developer experience
Study strength: 4/5

Findings from a study of open source software projects

International Journal of the Commons. · 2014

For your marketing

Treat governance rules, stewardship and shared infrastructure as product assets.

Summary

Project practices and governance arrangements vary; commons sustainability requires attention to social and institutional conditions.

Developer experience
Study strength: 3.5/5

Working for free? Motivations of participating in open source projects

International Journal of Electronic Commerce. · 2002

For your marketing

Offer learning, reputation and reciprocity alongside mission.

Summary

Participants report a mix of intrinsic, learning, career and reciprocal motives.

Developer experience
Study strength: 4/5

Newcomer OSS-Candidates: Characterizing Contributions of Novice Developers to GitHub

Peer-reviewed research · 2022

For your marketing

Create explicit first-step guidance, technically scoped starter tasks, and measure fork-to-PR conversion.

Summary

66% targeted software repositories; first commits were mainly development (74%), first PRs mainly management/maintenance (60%); 30% contributed PRs to original OSS repositories quantitatively, while 70% of 27 survey respondents reported onboarding; “finding a way to start” was the leading barrier.

AIDeveloper experience
Study strength: 3.5/5

Predicting long-time contributors for GitHub projects using machine learning

Peer-reviewed research · 2021

For your marketing

Use early signals to triage mentorship and follow-up, not as an automated gatekeeper for contributors.

Summary

Random forest performed best; repository and contributor metadata can predict long-time-contributor status, and the paper identifies important features for prediction.

Developer experience
Study strength: 3.5/5

Predicting open source contributor turnover from value-related discussions

Peer-reviewed research · 2023

For your marketing

Monitor discourse health and intervene on recurring value conflicts; treat moderation as retention infrastructure.

Summary

Respectfulness-related discussion predicted increased departures and fewer newcomers; social-power discussion predicted better retention.

Developer experience
Study strength: 3.5/5

Recommending good first issues in GitHub OSS projects

Peer-reviewed research · 2022

For your marketing

Automate candidate-task discovery, then have maintainers validate clarity, scope, and dependencies before labeling.

Summary

RecGFI reached up to 0.853 AUC, outperformed alternatives, and among reported recommendations 16 were confirmed real GFIs, with five resolved by newcomers.

Developer experience
Study strength: 4/5

An Empirical Study on the Survival Rate of GitHub Projects

Peer-reviewed research · 2022

For your marketing

Track activity decay and community breadth as leading indicators; design reactivation and maintainer succession plans.

Summary

Typical projects showed intensive coding-driven active periods followed by decline; survival patterns differed by ecosystem and activity/community factors were useful for understanding survivability.

Developer experience
Study strength: 3.5/5

The Signals that Potential Contributors Look for When Choosing Open-source Projects

Peer-reviewed research · 2019

For your marketing

Make project health, activity, contribution guidance, and welcoming norms legible on landing pages and issue lists.

Summary

The study identifies project signals that prospective contributors use when choosing projects, making visible project health and activity relevant to attraction.

Developer experience
Study strength: 3.5/5

A Systematic Review of API Evolution Literature

Peer-reviewed research · 2021

For your marketing

Treat compatibility, migration and documentation as product features; instrument breaking changes and communicate deprecations with ecosystem evidence.

Summary

API evolution research spans usability, misuse, maintenance, migration, documentation and recommendation; developers face breaking-change and adoption challenges.

Developer experience
Study strength: 3.5/5

SLR: From Saltzer and Schroeder to 2021…47 Years of Research on the Development and Validation of Security API Recommendations

Peer-reviewed research · 2023

For your marketing

Require usability validation—not just security review—for auth/crypto APIs; prioritize documentation, requirements and organizational practices alongside API structure.

Summary

Recommendations cluster into seven core ways to improve usability; very few are empirically validated, and usable-security API recommendations lag further behind.

Developer experience
Study strength: 3.5/5

An Empirical Study of API Usability

Peer-reviewed research · 2013

For your marketing

Test API designs with representative developers and measure task success, errors and discoverability rather than relying on style guidance alone.

Summary

The study provides empirical evidence that API usability is affected by discoverability, consistency and cognitive dimensions encountered while completing programming tasks.

Developer experience
Study strength: 3.5/5

Why API documentation is insufficient for developers: an empirical study

Peer-reviewed research · 2021

For your marketing

Pair reference docs with runnable examples, task-oriented guides and context; validate docs against real developer tasks.

Summary

Documentation alone can be insufficient because developers need contextual usage knowledge beyond reference material.

Developer experience
Study strength: 3.5/5

Evaluation of integrated software development environments: Challenges and results from three empirical studies

Peer-reviewed research · 2005

For your marketing

Use iterative, human-centered IDE evaluation; reduce representational clutter and improve affordances for tools, artifacts and reusable components.

Summary

IDEs are often functionality-oriented and difficult to learn/master; problems include representation of functionality and reusable program artifacts.

Developer experience
Study strength: 3.5/5

A mapping study on documentation in Continuous Software Development

Peer-reviewed research · 2022

For your marketing

Treat docs as continuously maintained product infrastructure; invest in automation, lightweight workflows and docs tooling integrated with delivery.

Summary

Documentation is often poor in Agile/Lean/DevOps contexts; the review maps challenges, practices and tools and highlights gaps for continuous-development documentation.

Developer experience
Study strength: 3.5/5

DevOps critical success factors — A systematic literature review

” Information and Software Technology · 2023

For your marketing

Use the CSF categories as a platform-engineering product/adoption checklist; map roadmap and enablement metrics to organizational, process, and technical success factors.

Summary

The review identifies 10 main CSF categories and proposes a synthesized model of their relationships.

Developer experience
Study strength: 3.5/5

Metrics to quantify software developer experience: a systematic mapping

Proceedings of the ACM on Human-Computer Interaction · 2022

For your marketing

Combine behavioral telemetry with direct experience measures; avoid presenting activity counts as a complete DevEx construct.

Summary

Most selected studies quantified experience through counts of developer activities in code; the mapping catalogs broader metric categories.

Developer experience
Study strength: 3.5/5

A Study of Interruptions During Software Engineering Activities

Proceedings of the ACM on Software Engineering · 2024

For your marketing

Build interruption-aware workflows, notification controls, and metrics that protect deep work without claiming universal productivity causality.

Summary

High-dominance on-screen interruptions increased code-comprehension time; combined interruption types affected code-review time, and effects varied by task/type.

Developer experience
Study strength: 3.5/5

Developers talking about code quality

Empirical Software Engineering · 2023

For your marketing

Use developer language and concrete code scenarios to define quality features, onboarding, diagnostics, and explainability in tooling.

Summary

Developers discussed multiple quality aspects and recommendations; the paper emphasizes alignment between practitioner perceptions and formal/metric-based quality measures.

Developer experience
Study strength: 3.5/5

The Governance of Open Source Initiatives: What Does It Mean to Be Community Managed?

Journal of Management & Governance · 2007

For your marketing

A compact governance checklist for defining decision rights, legitimacy, participation, and commercial boundaries before a developer-tool community scales.

Summary

The study identifies five core principles critical to community-managed governance and examines organization/governance in commercially influenced OSS communities.

Developer experience
Study strength: 3.5/5

Carrots and Rainbows: Motivation and Social Practice in Open Source Software Development

MIS Quarterly · 2012

For your marketing

Helps founders design contribution rituals, recognition, onboarding, and community norms instead of relying only on monetary rewards.

Summary

The study treats OSS motivation as embedded in social practice rather than as a simple individual incentive calculation, linking contributor motives with community practices.

Developer experience
Study strength: 3.5/5

What to Share, When, and Where: Balancing the Objectives and Complexities of Open Source Software Contributions

Empirical Software Engineering · 2020

For your marketing

A practical decision framework for open-core licensing, project selection, community investment, competitive disclosure, and deciding whether to seed or join an OSS ecosystem.

Summary

The study identifies 12 contribution objectives and 15 complexities. Objectives include reputation, supplier/partner/competitor management, and exploiting external knowledge; complexities include loss of control, competitive disadvantage, negative exposure, contribution cost, and choosing a new versus existing community.

Developer experience
Study strength: 3.5/5

Motivation of Software Developers in Open Source Projects: An Internet-Based Survey of Contributors to the Linux Kernel

Research Policy · 2003

For your marketing

Informs onboarding and retention: cultivate project identity, make contributor benefits tangible, respect time constraints, and give teams clear goals and meaningful ownership/self-efficacy.

Summary

Engagement was particularly determined by identification as a Linux developer, pragmatic motives to improve one’s own software, and tolerance of time investment. Team activity was particularly related to evaluation of team goals, perceived indispensability, and self-efficacy.

Developer experience
Study strength: 3.5/5

Modern Code Review: A Case Study at Google

Proceedings of the 40th International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP '18) · 2018

For your marketing

Use the findings to design review workflows and tooling around reviewability, education, shared code ownership, norms, and reviewer experience—not only defect detection—and to instrument satisfaction and friction at scale.

Summary

Code review at Google serves more than bug finding: the study examines motivations, practices, developer satisfaction, and challenges in a mature, lightweight, tool-based process. The evidence highlights code review's normative, educational, testing, accident-prevention, and gatekeeping functions, alongside recurring challenges.

Developer experience
Study strength: 3.5/5

An empirical study of the impact of modern code review practices on software quality

Empirical Software Engineering · 2016

For your marketing

Prioritize review coverage, meaningful reviewer participation, and domain-relevant reviewer assignment in developer-tool metrics and workflow design; treat these as risk signals rather than simplistic productivity scores.

Summary

Review coverage, participation, and reviewer expertise each share a significant link with software quality; poorly reviewed code is associated with more post-release defects.

Developer experience
Study strength: 3.5/5

How Do Software Engineers Understand Code Changes? An Exploratory Study in Industry

Proceedings of the ACM SIGSOFT 20th International Symposium on the Foundations of Software Engineering (FSE '12) · 2012

For your marketing

Build IDE, pull-request, and change-intelligence features that expose rationale, completeness, consistency, dependency risk, and issue-aligned decomposition; measure time-to-understanding and information gaps as developer-experience outcomes.

Summary

Understanding changes is indispensable, but engineers struggle to obtain completeness, consistency, and especially risk information. Composite changes are easier to understand when decomposed into issue-aligned sub-changes, yet current tools provide inadequate decomposition support.

Developer experience
Study strength: 3.5/5

Convergent contemporary software peer review practices

Proceedings of the 2013 9th Joint Meeting on Foundations of Software Engineering (ESEC/FSE 2013) · 2013

For your marketing

Benchmark review latency, participation, defect proxies, and knowledge diffusion across customers or teams; position code review as a collaboration and bus-factor intervention, not merely a gate.

Summary

Peer-review parameters converge across otherwise different projects. The knowledge-sharing measure indicates that peer review increases the number of distinct files a developer knows about by 66% to 150%, depending on project.

Developer experience
Study strength: 4/5

The effects of change decomposition on code review—a controlled experiment

PeerJ Computer Science · 2019

For your marketing

Make small, self-contained changes and issue-aligned pull requests a first-class workflow; provide automated decomposition/reviewability guidance and track false positives, context switching, and review precision rather than only review speed.

Summary

Decomposition significantly reduced false positives and produced more structured context-seeking review behavior; it did not significantly change the number of defects found, suggested improvements, total review time, or measured rationale understanding. The authors recommend self-contained, untangled changes.

Developer experience
Study strength: 3.5/5

How developers use API documentation: an observation study

Communication Design Quarterly Review · 2019

For your marketing

Use as a product-design checklist: instrument onboarding and docs, support different learning behaviors, and test documentation with realistic developer tasks before scaling an API.

Summary

Documentation use and developer activities differed across participants; API documentation should accommodate those differences. The study discusses guidelines for optimizing documentation.

Developer experienceProduct adoption
Study strength: 3.5/5

Enabling Data-Driven API Design with Community Usage Data: A Need-Finding Study

CHI '20: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · 2020

For your marketing

Build feedback loops around issue data, usage traces, and support questions; mine recurring mistakes and workarounds, and use them to prioritize API redesign and documentation instead of relying only on feature requests.

Summary

Designers primarily relied on bug reports and peer reviews because formal usability testing was prohibitively expensive. They wanted real-world use cases and users’ mental models, including where users got stuck, workarounds, mistakes, and corner cases; the paper proposes mining and elicitation tools.

Developer experience
Study strength: 3.5/5

The characteristics and motivations of library open source software developers: An empirical study

Library & Information Science Research · 2015

For your marketing

For OSS products with domain communities, recruit credible domain practitioners, emphasize learning/altruism and mission, and tailor governance and recognition to the community’s professional identity.

Summary

LOSS developers showed high intrinsic (altruism, fun) and internalized-extrinsic (learning, personal needs) motivation, greater gender diversity, higher formal education, prior library work experience, and a strong library ethos; they joined later in their careers than general OSS peers.

Developer experience
Study strength: 3.5/5

Two case studies of open source software development: Apache and Mozilla

ACM Transactions on Software Engineering and Methodology · 2002

For your marketing

Design contribution funnels that distinguish core maintainers from broad bug reporters and occasional contributors; measure contributor concentration, review/repair participation, and defect-response time when building an OSS-backed developer tool or data product.

Summary

Open-source development showed broad participation but a concentrated core: Apache's top 15 developers contributed more than 83% of modification requests and about 88% of added lines, while defect repair involved a wider community; the authors quantify productivity, defect density, and repair intervals and use the results to discuss high-performance commercial/open-source hybrids.

Prefer to write? Send Jon a message.