共找到 20 条结果
Algorithmic recourse provides counterfactual action plans that help people overturn unfavorable AI decisions. While diverse recourse sets may improve transparency and motivation, they may also impose cognitive load and negative emotions by increasing counterfactual reasoning demands. To examine this trade-off, we conducted a between-subjects controlled experiment (N=750) that manipulated recourse-set diversity and size, and evaluated these effects on psychological benefits and costs. Results show that diversification enhances psychological benefits (e.g., willingness to act) for small sets without incurring additional psychological costs, whereas for large sets, it makes cognitive load more salient. These findings suggest that naively diversifying recourse can burden decision subjects, underscoring the need for new diversification methods that incorporate human cognition and psychology to mitigate such costs.
Missing significant amounts of school during K-12 education is known to put students' cognitive and social development at risk. Alternatives such as home instruction and online learning are common, but lack sufficient interaction with peers and teachers in the classroom. Mobile remote presence systems, or telepresence robots, are promising for homebound students because they provide embodiment and mobility in addition to the real-time participation offered by video conferencing technologies. Research is needed, however, for telepresence robots to meet the complex needs of homebound students participating remotely in the K-12 classroom context. We present findings from four multi-week deployments with homebound K-12 students attending classes via telepresence robots. The homebound students' experiences were documented in a total of 15 interviews and analyzed qualitatively as case studies. The homebound student participants and their deployment contexts differed from one another along multiple dimensions, and while some benefits of mobile remote attendance were enjoyed by all participants, each participant also experienced unique benefits. Some challenges with hearing, seeing, and mo
Signal recognition plays a critical role in species interactions and can be enhanced by learning signal characteristics through experience. In brood parasitism, host species may use visual cues to recognize and reject parasite eggs from their nests; because egg appearances vary within and between host individuals, a host can improve recognition by learning a tailored template of its own eggs. Nevertheless, constitutive and induced costs of learning may inhibit an extended learning period. We use a simple model of signal detection and learning to study how the benefits of learning are affected by different sources of variation in the learning signal. We find that phenotypic variation in egg appearances within a host hinders learning by adding noise to the signals, whereas genotypic variation between individuals promotes learning by carrying more information in the signals. Moreover, we consider environmental variation that can cause egg appearances to fluctuate across clutches over time. We find that such environmental variation reduces the fitness of learning hosts by distorting the signals, creating an effective cost that can offset the benefits of learning. Our results imply that
From medicine to marketing to social sciences, the promise of tailoring interventions to individuals is undeniable. However, practical applications force weighing personalization's potential benefits with its possible increased cost and fragility. We introduce a statistical hypothesis test that evaluates, given historical data, evidence that a personalized intervention policy's performance will surpass deploying the best single intervention. The test maintains strict type-I error control while achieving asymptotic normality with the minimal possible variance under specified conditions. Results on diverse datasets from job training, depression treatment, education and recommendation systems demonstrate the test's versatility and its superior performance over alternatives. This test can support decision-makers throughout the intervention sciences by providing a simple and powerful quantification of the potential benefits of personalization.
Despite the well-acknowledged benefits of physical activity for type 2 diabetes (T2D) prevention, the literature surprisingly lacks validated models able to predict the long-term benefits of exercise on T2D progression and support personalized risk prediction and prevention. To bridge this gap, we developed a novel mathematical model that formalizes the link between exercise and short- and long-term glucose-insulin dynamics to predict the benefits of regular exercise on T2D progression. The model quantitatively captured the dose-response relationship (larger benefits with increasing intensity and/or duration of exercise), it consistently reproduced the benefits of clinical guidelines for diabetes prevention, and it accurately predicted persistent benefits following interruption of physical activity, in line with real-world evidence from the literature. These results are encouraging and can be the basis for future development of decision support tools able to assist patients and clinicians in tailoring preventive lifestyle interventions.
Disputes over cost allocation can present a significant barrier to investment in shared infrastructure. While it may be desirable to allocate cost in a way that corresponds to expected benefits, investments in long-lived projects are made under conditions of substantial uncertainty. In the context of electricity transmission, uncertainty combined with the inherent complexity of power systems analysis prevents the calculation of an estimated distribution of benefits that is agreeable to all participants. To analyze aspects of the cost allocation problem, we construct a model for transmission and generation expansion planning under uncertainty, enabling the identification of transmission investments as well as the calculation of benefits for users of the network. Numerical tests confirm the potential for realized benefits at the participant level to differ significantly from ex ante estimates. Based on the model and numerical tests we discuss several issues, including 1) establishing a valid counterfactual against which to measure benefits, 2) allocating cost to new and incumbent generators vs. solely allocating to loads, 3) calculating benefits at the portfolio vs. the individual pr
We seek to identify the most relevant benefits offered by Medicare Advantage Health Plans that drive membership and market share. As an example, we explore plans operating in a single county in New Jersey between 2018 and 2023. A dataset of benefits from publicly available data sources was created and the variance inflation factor was applied to identify the correlation between the extracted features, to avoid multicollinearity and overparameterization problems. We categorized the variable Market Share and used it as a multinomial response variable with three categories: less than 0.3\%, 0.3\% to 1.5\%, and over 1.5\%. Categories were chosen to achieve approximately uniform distribution of plans (47, 60, and 65 respectively). We built a multinomial Lasso model using 5-fold cross-validation to tune the penalty parameter. Lasso forced some features to be dropped from the model, which reduces the risk of overfitting and increases the interpretability of the results. For each category, important variables are different. Certain brands drive market share, as do PPO plans and prescription drug coverage. Benefits, particularly ancillary benefits that are not part of CMS's required benefit
Transitioning to a net-zero economy requires a nuanced understanding of homeowners decision-making pathways when considering the adoption of Low Carbon Technologies (LCTs). These LCTs present both personal and collective benefits, with positive perceptions critically influencing attitudes and intentions. Our study analyses the relationship between two primary benefits: the household-level financial gain and the broader environmental advantage. Focusing on the intention to adopt Rooftop Photovoltaic Systems, Energy Efficient Appliances, and Green Electricity Tariffs, we employ Partial Least Squares Structural Equation Modeling to demonstrate that the adoption intention of the LCTs is underpinned by the Theory of Planned Behaviour. Attitudes toward the LCTs are more strongly related to product-specific benefits than affective constructs. In terms of evaluative benefits, environmental benefits exhibit a higher positive association with attitude formation compared to financial benefits. However, this relationship switches as homeowners move through the decision process with the financial benefits of selected LCTs having a consistently higher association with adoption intention. At the
Context. Advancements in Machine Learning (ML) are revolutionizing every application domain, driving unprecedented transformations and fostering innovation. However, despite these advances, several organizations are experiencing friction in the adoption of ML-based technologies, mainly due to the shortage of ML professionals. In this context, Automated Machine Learning (AutoML) techniques have been presented as a promising solution to democratize ML adoption. Objective. We aim to provide an overview of the evidence on the benefits and limitations of using AutoML tools. Method. We conducted a multivocal literature review, which allowed us to identify 54 sources from the academic literature and 108 sources from the grey literature reporting on AutoML benefits and limitations. We extracted reported benefits and limitations from the papers and applied thematic analysis. Results. We identified 18 benefits and 25 limitations. Concerning the benefits, we highlight that AutoML tools can help streamline the core steps of ML workflows, namely data preparation, feature engineering, model construction, and hyperparameter tuning, with concrete benefits on model performance, efficiency, and scal
We leverage historical outage data to quantify the resilience benefits of undergrounding a circuit. The historical performance of the overhead circuit is compared to the performance if the circuit had been undergrounded in the past. The number of outages, customers affected, outage duration, and customer hours lost are used as metrics to quantify the benefits of undergrounding. Results show 75% and 78% reductions in customer hours lost per year for two selected circuits, as well as a significant reduction in the average number of outages and customers affected per year, highlighting the advantages of undergrounding. The benefits of investments that result in 10% faster outage restoration are also calculated by rerunning history with the faster restoration included.
Modeling the joint distribution of data samples and their properties allows to construct a single model for both data generation and property prediction, with synergistic benefits reaching beyond purely generative or predictive models. However, training joint models presents daunting architectural and optimization challenges. Here, we propose Hyformer, a transformer-based joint model that successfully blends the generative and predictive functionalities, using an alternating attention mechanism and a joint pre-training scheme. We show that Hyformer is simultaneously optimized for molecule generation and property prediction, while exhibiting synergistic benefits in conditional sampling, out-of-distribution property prediction and representation learning. Finally, we demonstrate the benefits of joint learning in a drug design use case of discovering novel antimicrobial~peptides.
This study explores the impact of unemployment benefits on employment quality, job stability, and tenure within complex labour market dynamics. Given the macroeconomic consequences of changes in unemployment benefits, including their impact on employment rates and output growth, we develop a closed macroeconomic model that integrates heterogeneous households and adaptive firms and incorporates real-world entry-exit market mechanisms. The model considers personal values, social norms, and social network formation among workers as we examine the role of social contacts in mediating the effects of unemployment benefits on job-matching quality and labour market outcomes. We simulate the model across various scenarios where unemployment benefit schemes differ in level and/or duration. Our results suggest that extending the duration of unemployment benefits does not necessarily improve job-matching quality. Longer benefits may indeed reduce the effectiveness of social networks in job finding, indicating that social contacts play a key role in labour market dynamics.
The United States has long pursued regulations that aim to reduce fossil fuel use. However, while potential emission reduction motivates the introduction and enforcement of these regulations, realization of this potential does not obfuscate the need for prudent economic policy. Scrutinizing nearly two decades of climate regulations in the transportation, industrial, and electric power sector, we enumerate their associated cost effectiveness. Our findings are twofold. Firstly, we find that whereas there are instances where climate regulations carry net economic benefits, there are also cases where compliance costs substantially exceed the social cost of carbon (SCC). Aggregated across sectors and subject to the precise SCC leveraged, up to 65 percent of climate regulations have abatement costs that exceed the SCC. This exceedance is particularly profound in the transportation sector where up to 82 percent of regulations reviewed have abatement costs that exceed the SCC. Secondly, we find that whereas the economic benefits of climate regulations generally exceed the economic costs, this exceedance is largely contingent on the presence of non-climate benefits. Aggregated across sector
Context: Machine Learning Operations (MLOps) has emerged as a set of practices that combines development, testing, and operations to deploy and maintain machine learning applications. Objective: In this paper, we assess the benefits and limitations of using the MLOps principles in online supervised learning. Method: We conducted two focus group sessions on the benefits and limitations of applying MLOps principles for online machine learning applications with six experienced machine learning developers. Results: The focus group revealed that machine learning developers see many benefits of using MLOps principles but also that these do not apply to all the projects they worked on. According to experts, this investment tends to pay off for larger applications with continuous deployment that require well-prepared automated processes. However, for initial versions of machine learning applications, the effort taken to implement the principles could enlarge the project's scope and increase the time needed to deploy a first version to production. The discussion brought up that most of the benefits are related to avoiding error-prone manual steps, enabling to restore the application to a pr
[Context] The adoption of micro-frontends architectures has gained traction as a promising approach to enhance modularity, scalability, and maintainability of web applications. [Goal] The primary aim of this research is to investigate the benefits and limitations of migrating a real-world application to a micro-frontends architecture from the perspective of the developers. [Method] Based on the action research approach, after diagnosis and planning, we applied an intervention of migrating the target web application to a micro-frontends architecture. Thereafter, the migration was evaluated in a workshop involving the remaining developers responsible for maintaining the application. During the workshop, these developers were presented with the migrated architecture, conducted a simple maintenance task, discussed benefits and limitations in a focus group to gather insights, and answered a questionnaire on the acceptance of the technology. [Results] Developers' perceptions gathered during the focus group reinforce the benefits and limitations reported in the literature. Key benefits included enhanced flexibility in technology choices, scalability of development teams, and gradual migra
The demands for accurate and representative generative AI systems means there is an increased demand on participatory evaluation structures. While these participatory structures are paramount to to ensure non-dominant values, knowledge and material culture are also reflected in AI models and the media they generate, we argue that dominant structures of community participation in AI development and evaluation are not explicit enough about the benefits and harms that members of socially marginalized groups may experience as a result of their participation. Without explicit interrogation of these benefits by AI developers, as a community we may remain blind to the immensity of systemic change that is needed as well. To support this provocation, we present a speculative case study, developed from our own collective experiences as AI researchers. We use this speculative context to itemize the barriers that need to be overcome in order for the proposed benefits to marginalized communities to be realized, and harms mitigated.
Web3 provides users and service providers several benefits not found in Web2. However, despite the benefits provided, Web3 faces several obstacles that prevent the paradigm from gaining widespread adoption. Developers should understand the benefits and limitations of the technology in order to create more accessible Web3 smart applications.
We propose a novel redaction methodology that can be used to sanitize natural text data. Our new technique provides better privacy benefits than other state of the art techniques while maintaining lower redaction levels.
We present a new framework to conceptualize and operationalize the total user experience of search, by studying the entirety of a search journey from an utilitarian point of view. Web search engines are widely perceived as "free". But search requires time and effort: in reality there are many intermingled non-monetary costs (e.g. time costs, cognitive costs, interactivity costs) and the benefits may be marred by various impairments, such as misunderstanding and misinformation. This characterization of costs and benefits appears to be inherent to the human search for information within the pursuit of some larger task: most of the costs and impairments can be identified in interactions with any web search engine, interactions with public libraries, and even in interactions with ancient oracles. To emphasize this innate connection, we call these costs and benefits Delphic, in contrast to explicitly financial costs and benefits. Our main thesis is that the users' satisfaction with a search engine mostly depends on their experience of Delphic cost and benefits, in other words on their utility. The consumer utility is correlated with classic measures of search engine quality, such as ran
Ensembles of Deep Neural Networks, Deep Ensembles, are widely used as a simple way to boost predictive performance. However, their impact on algorithmic fairness is not well understood yet. Algorithmic fairness examines how a model's performance varies across socially relevant groups defined by protected attributes such as age, gender, or race. In this work, we explore the interplay between the performance gains from Deep Ensembles and fairness. Our analysis reveals that they unevenly favor different groups, a phenomenon that we term the disparate benefits effect. We empirically investigate this effect using popular facial analysis and medical imaging datasets with protected group attributes and find that it affects multiple established group fairness metrics, including statistical parity and equal opportunity. Furthermore, we identify that the per-group differences in predictive diversity of ensemble members can explain this effect. Finally, we demonstrate that the classical Hardt post-processing method is particularly effective at mitigating the disparate benefits effect of Deep Ensembles by leveraging their better-calibrated predictive distributions.