The Overall Score for each submission should reflect your assessment of the submissions contributions. option after submission is discouraged but justified requests from Access to proprietary data in A/B/n testing has been adopted by many technology companies as a data-driven approach to product design and optimization. The work situates itself in the context of related work. Please set the anonymous option for review. There has been recent interest by payers, health care systems, and researchers in the development of machine learning and artificial intelligence models that predict an individual's probability of developing opioid use disorder. FAccT papers naturally differ in style and focus from the work featured at other venues. In this Anonymized smartphone-based mobility data has been widely adopted in devising and evaluating COVID-19 response strategies such as the targeting of public health resources. This topic has received extensive attention We study the problem of learning fair prediction models for unseen test sets distributed differently from the train set. Bedrock concepts in computer science---such China's Social Credit System (SCS, or shehui xinyong tixi) is expected to become the first digitally-implemented nationwide scoring system with the purpose to rate the behavior of citizens, companies, and other entities. Papers that (1) describe experiments with users and/or deployed systems (e.g., websites or apps), or (2) rely on sensitive user data (e.g., social network information), must follow basic precepts of ethical research and subscribe to community norms. It can be tempting to only comment on the weaknesses; however, Track Chairs and Program Chairs need to understand both the strengths and the weaknesses in order to make an informed decision. discipline-specific journals. Write thoughtful and constructive reviews. https://eur-lex.europa.eu/eli/reg/2016/679/oj T. Kamishima, P.-N. Schwab, and M. D. Ekstrand. Recently, social media sites like Facebook and Twitter have been severely criticized by policy makers, and media watchdog groups for allowing fake news stories to spread unchecked on their platforms. Your assessment should be based on the quality of the contribution, not its style. field address the problems and opportunities of intersectional Claims are well supported by theoretical analysis, evidence, argument, and/or experimental results. Authors unsure about topical fit or ethical issues are welcome to contact the PC. previous years.) To receive news about ACM FAccT, follow @facctconference on After the peer review and cross-disciplinary review phase, the Track Chair for each submission will initiate a discussion via HotCRP to encourage the reviewers to come to a consensus. The fourth annual ACM FAccT conference will take place online March 3-10, 2021. Top tier venues in computer science can be thought of as leading conferences such as CVPR, NIPS, ICML, CHI, KDD, ACL, ICWSM, SIGIR, SIGMOD, STOC, or top tier journals. For Track Chairs and Program Chairs, it provides a basis for decision-making about a submission. Review content serves two purposes. include a subsection describing these issues. What kinds of marginalization are relevant to and do consider changing your mind in light of their comments, if appropriate. Twitter and join our mailing list facct-announce. There is one key exception. Using inappropriate or derogatory language is not acceptable. Authors will upload videos to their preferred cloud drive service and share publicly accessible links for each video with the conference organizers. While it allows sellers to increase their profits, it also raises several concerns in terms of fairness. Posters (in PDF format) are encouraged for the online booth, but are not required. Please note that in contrast to proceedings, if they are accepted. Switching from archival to non-archival option after submission is discouraged, but justified requests from authors will be examined by PC Chairs on a case-by-case basis. ACM FAT* is an international and interdisciplinary peer-reviewed conference that seeks to publish and present the best work examining the fairness, accountability, and transparency of algorithmic systems. HotCRP.com signin Sign in using your HotCRP.com account. Automated systems for detecting harmful social media content are afflicted by a variety of biases, some of which originate in their training datasets. However, in this work, we show that removing spurious features Training and evaluation of fair classifiers is a challenging problem. Although the double-blind review process reduces the risk of bias, reviews can inadvertently contain subtle discrimination, which should be actively avoided. FAT* '19: Proceedings of the Conference on Fairness, Accountability, and Transparency, FAT* '19: Conference on Fairness, Accountability, and Transparency, Chicago , You can read more on any of the above points here. ACM Conference on Fairness, Accountability, and Transparency (ACM FAccT). ACM FAccT is committed to ensuring that no body is unable to present their work at the in-person conference due to resource constraints, and as such there is a substantial travel scholarship fund available to support in-person attendance. Although you may have the opportunity to review this rebuttal and revise your recommendation, generally speaking, your overall assessment should reflect on whether you believe the paper merits acceptance except for minor revisions. 9%! Area chairs will oversee the reviewing process. If you believe a paper requires significant revision, or that you would need to review the outcome of the revision in order to vote to accept the paper, you should generally vote to reject. will take place in the context of a worldwide reckoning with racism and New York, NY, Feb. 25, 2021 (GLOBE NEWSWIRE) -- The 2021 ACM Conference on Fairness, Accountability and Transparency (ACM FAccT), to be held virtually from March 3-10, brings together. DO NOT talk to anyoneincluding other reviewers or Track co-Chairsabout submissions that are assigned to you without prior approval from the submissions Track Chair; other reviewers or Track co-Chairs may have conflicts with these submissions. Papers that are neither in ACM format nor follow the simplified FAccT is committed to strengthening the disciplinary and interdisciplinary areas it touches by maintaining a high standard of quality in the submissions it accepts. The Fourth Workshop on Responsible Recommendation (FAccTRec 2021) was held in conjunction with the 15th ACM Conference on Recommender Systems on September, 2021 at Amsterdam, Netherlands, in a hybrid format. Our results speak to a tension between the desire to keep a proprietary model secret and the ability to offer model explanations. IL , submission area(s) by Sept 30. read the supplementary materials, so authors are encouraged to use them In your response, Please address the degree to which the following statements apply to this work. DO NOT talk to anyone about specific submissions, reviews, or discussions of papers that you reviewed after decisions have been announced. 2018. From creating paintings to generating novel art styles, AI based generative art has showcased a variety of applications. In this paper, we investigate such online A/B/n Increasingly, programming tasks involve automating and deploying sensitive decision-making processes that may have adverse impacts on individuals or groups of people. building, analysis, and practical impact alongside psychological, As of May 9, about 65% of registrations include in-person attendance. That said, if you think the other reviewers are not correct, you are not required to change your mind. Though familiar at first blush, it lacks a single precise meaning. Strong work makes a contribution that his important to the FAccT academic field. For general conference information, see https://facctconference.org/2021/. New York, NY, June 15, 2022 - The 2022 ACM Conference on Fairness, Accountability and Transparency (ACM FAccT) will be held online and in-person in Seoul, South Korea from June 21-24 2022. Non-archival papers will only appear as abstracts in the will shift to the new ACM workflow for article templates and publication Your overall assessment should reflect whether you believe the paper merits acceptance except for minor revisions. Disentangling Inuence: Using disentangled representations to audit model predic- workshop papers: ACM FAccT welcomes submission of work that has It is useful for the Track Chairs and Program Chairs if you include a list of arguments for and against acceptance. Area Chairs should return their meta-reviews by April 5 11:59 pm AoE. Recently, deep anomaly detection methods were shown to achieve superior results particularly in complex data such as images. The research community is young but growing fast. consider dimensions beyond individual decisions, including equity Best can be defined in a variety of ways, including quality, clarity, originality, interdisciplinarity and significance. General Data Protection Regulation. Confidentiality of submitted material will be effort by your area selections and the abstract of your paper. You may Questions? You will be asked to provide a Confidence Score between 1 and 5 for each submission, which concerns the level of confidence you have in your own expertise regarding the topic of the submission. In a very limited number of cases where an otherwise excellent paper requires a significant but actionable revision, Program Chairs can select such submissions for shepherding . Pre-registration only requires that you "save a draft" of your submission. You should NOT assume that you were assigned a representative sample of submissions, nor should you adjust your scores to match the overall conference acceptance rates. reconsider their reviews and scores in light of rebuttals before final The research has significance and insights relevant to practitioners, policy makers, or those beyond academia. You may not submit papers that are identical, or substantially similar to versions that are currently under review at another conference, have been previously published, or have been accepted for publication. to ensure that authors receive high quality feedback on their submissions. Keep in mind that reviewers are not obligated to read the appendix or supplementary materials. Conspicuously absent from the literature is a rigorous treatment of public trust in AI. There are three main exceptions to this rule: Please contact [email protected] for any KDD 2022 (acceptance rate: 14.99%) L. Zheng, J. Xiong, Y. Zhu, and J. Technical reports and pre-prints: ACM FAccT welcomes submission of work that is already available without peer reviewing as a technical report (e.g., in SSRN, arXiv, or similar). In cases where the Program Chairs (PC) have concerns about the ethics of the work in a submission, the PC will consider the ethical soundness and justification of the submission, just as it does its technical soundness. papers will be released prior to the conference. that (1) describe experiments with users and/or deployed systems (e.g., Your paper ID can be found in EasyChair, or in the subject line of the acceptance email from [email protected] (sent in early April). accountability, and transparency in socio-technical systems. To that end, if you need to cite existing work, please be as precise as possible and give a complete citation. Instead, meanings range from typical or characteristic, to a proportionate match between sample and population, to a more Government agencies are embracing machine learning to support a variety of resource allocation decisions. However, there has been AI technology offers opportunities to expand virtual and physical access for people with disabilities. ACM FAccT solicits work from a wide variety of disciplines, including computer science, statistics, law, social sciences, the humanities, and policy, and multidisciplinary scholarships on fairness, accountability and transparency in computational systems (broadly construed). In your response, please address the degree to which the following statements apply to this work. judged by the same quality standards, regardless of whether the authors Our event management team will then upload them to YouTube, and the Hopin platform. There is one key exception. formal proceedings. ACM FAccT solicits work from a wide variety of disciplines, including computer science, statistics, law, social sciences, the humanities, and policy, and multidisciplinary scholarships on fairness, accountability and transparency in computational systems (broadly construed). The authors are careful and transparent about evaluating both the strengths and weaknesses of their work. ACM FAccT FAccT 2021 Early Bird Registration, call for ACM FAccT Doctoral Consortium (DC). from a wide variety of disciplines, including computer science, towards more ethical computing scholarship in future years. Chairs to better anticipate the submission load and to make necessary Submissions that do not comply with this policy will be rejected without review. Authors must omit their names and affiliations from submissions, and avoid obvious identifying statements. The PC chairs consider this to be an integral part of the reviewing process and a foundational step in creating and constructing impactful interdisciplinary work. The ACM CHI Conference on Human Factors in Computing Systems (or CHI as it's typically called) is the premier international conference for the field of Human-Computer Interaction (HCI). : How Externalities of Size Complicate Notions of Solidarity and Actuarial Fairness, Removing Spurious Features can Hurt Accuracy and Affect Groups Disproportionately, Evaluating Fairness of Machine Learning Models Under Uncertain and Incomplete Information, Data Leverage: A Framework for Empowering the Public in its Relationship with Technology Companies, The Use and Misuse of Counterfactuals in Ethical Machine Learning, Mitigating Bias in Set Selection with Noisy Protected Attributes, What We Can't Measure, We Can't Understand: Challenges to Demographic Data Procurement in the Pursuit of Fairness, Standardized Tests and Affirmative Action: The Role of Bias and Variance, The Sanction of Authority: Promoting Public Trust in AI, Algorithmic Fairness in Predicting Opioid Use Disorder using Machine Learning, Avoiding Disparity Amplification under Different Worldviews, Spoken Corpora Data, Automatic Speech Recognition, and Bias Against African American Language: The case of Habitual 'Be', All Holdings within the ACM Digital Library. What constitutes a "fair" allocation of the items among them? USA, Front matter (Title, Copyright, Contents, Welcome from General Chairs, Welcome from the Program Chairs), FAccT '23: 2022 ACM Conference on Fairness, Accountability, and Transparency, Model Reconstruction from Model Explanations, Actionable Recourse in Linear Classification, Efficient Search for Diverse Coherent Explanations, On Human Predictions with Explanations and Predictions of Machine Learning Models: A Case Study on Deception Detection, 50 Years of Test (Un)fairness: Lessons for Machine Learning, Fairness and Abstraction in Sociotechnical Systems, Clear Sanctions, Vague Rewards: How China's Social Credit System Currently Defines "Good" and "Bad" Behavior, A Taxonomy of Ethical Tensions in Inferring Mental Health States from Social Media, Dissecting Racial Bias in an Algorithm that Guides Health Decisions for 70 Million People, Disparate Interactions: An Algorithm-in-the-Loop Analysis of Fairness in Risk Assessments, An Empirical Study of Rich Subgroup Fairness for Machine Learning, The Profiling Potential of Computer Vision and the Challenge of Computational Empiricism, Bias in Bios: A Case Study of Semantic Representation Bias in a High-Stakes Setting, Equality of Voice: Towards Fair Representation in Crowdsourced Top-K Recommendations, Analyzing Biases in Perception of Truth in News Stories and Their Implications for Fact Checking, On Microtargeting Socially Divisive Ads: A Case Study of Russia-Linked Ad Campaigns on Facebook, SIREN: A Simulation Framework for Understanding the Effects of Recommender Systems in Online News Environments, Controlling Polarization in Personalization: An Algorithmic Framework, Fair Algorithms for Learning in Allocation Problems, Fair Allocation through Competitive Equilibrium from Generic Incomes, A Moral Framework for Understanding Fair ML through Economic Models of Equality of Opportunity, Beyond Open vs. Closed: Balancing Individual Privacy and Public Accountability in Data Sharing, Who's the Guinea Pig? These workflow and formatting changes will improve This typically corresponds to about 7,500 words for the main content. 2021. Trust is needed for facilitating collaboration between scientists who may share datasets and Representativeness is a foundational yet slippery concept. At least one author of each accepted paper is required to register for, (virtually) attend, and present the work at the conference in order for the paper to appear in the conference proceedings in the ACM Digital Library. For LAW and SSH this would regard acceptance in top tier international peer reviewed journals. Text should be dark, with lots of space around the letters, and in a legible and suitably large font. Authors will be able to make changes to their titles and abstracts up until the full paper submission deadline, however the preliminary title and abstract should be representative of the submitted work. If English style or grammar are issues, please write your review politely, and avoid language that could be perceived as discriminatory. faced in their work. If using LaTeX, please use the template given in sample-manuscript.tex when downloading the latest version of the ACM LaTeX documents. A variety of programs are available to embed captions into your videos. This paper argues for more caution with the use of counterfactuals when the facts to be Subset selection algorithms are ubiquitous in AI-driven applications, including, online recruiting portals and image search engines, so it is imperative that these tools are not discriminatory on the basis of protected attributes such as gender or race. In a very limited number of cases where an otherwise excellent paper requires a significant but actionable revision, Program Chairs can select such submissions for shepherding. The in-person conference will take place in the COEX exhibition centre in Seoul, South Korea on June 21-24 2022 Korea Standard Time (KST). The use of counterfactuals for considerations of algorithmic fairness and explainability is gaining prominence within the machine learning community and industry. The cross-disciplinary nature of this conference requires specific attention to the review process. Such Please upload only one document, appending any appendices or supplementary material to the end of the submission. In this case, the authors should not cite the report, so as to preserve anonymity. Anomaly detection aims to find instances that are considered unusual and is a fundamental problem of data science. choose the archival or non-archival option. A natural remedy is to remove such features from the model. Upon acceptance, the titles, authorship, and abstracts of accepted papers will be released. Such comments might include explicit comparisons of the submission to other submissions and criticisms that are more bluntly stated. Archival and Non-archival Submissions. Weve marked the sections of this document with . The submission adequately informs the reader about the research. Authors are not required or expected to submit a response. Each paper will be allocated to *one* proceedings session during the conference, either as part of the in-person program in Seoul. ACM FAT* papers naturally differ in style and focus from the work featured at other venues. The latest data we have shows there are 11,240 reviews in the system. Authors are also responsible for We particularly seek to evaluate technical solutions with respect to existing problems, reflecting upon their benefits and risks; to address pivotal questions about economic incentive structures, perverse implications, distribution of power, and redistribution of welfare; and to ground research on fairness, accountability, and transparency in existing legal requirements. loans or police officers) amongst several groups, in order to maximize some objective (e.g. After all, risk Kearns, Neel, Roth, and Wu [ICML 2018] recently proposed a notion of rich subgroup fairness intended to bridge the gap between statistical and individual notions of fairness. May 8-13, 2021 Yokohama, Japan May 8-13, 2021 Online Virtual Conference . We have assessed travel intentions from most of our authors, and (depending on funding) up to 55% intend to travel to Seoul. The PC will take a broad view of what constitutes an ethical concern, and authors agree to be available at any time during the review process to rapidly respond to queries from the PC regarding ethical considerations. issues are welcome to contact the PC. learnings from this optional experiment to guide FAccT conference work If you need to cite existing work to justify one of your comments, please be as precise as possible and give a complete citation. ACM FAccT uses a mutually anonymous review process. with the review process, authors are asked to select one or more of the How should the Your assessment should be based on the quality of the contribution, not its style. #FAccT2023 FAccT: Fairness, Accountability, and Transparency. When consequential decisions are informed by algorithmic input, individuals may feel compelled to alter their behavior in order to gain a system's approval. loans given that are repaid, or criminals that are Two food banks catering to populations of different sizes with different needs must divide among themselves a donation of food items.