This is the online repository of the paper "Context-Aware Code Change Embedding for Better Patch Correctness Assessment" under review by SANER2021. We release the source code of Cache, the patches used in our evaluation, as well as the experiment results.

Patches: Three patch benchmarks included in our study.

Tian: The patches from Tian's ASE20 paper.

Wang: The patches from Wang's ASE20 paper.

Cache: The patches collected by ourselves, which is consist of 17,377 deduplicated overfitting patches from RepairThemAll and 17,377 instances from ManySStuBs(used as correct patches).

Results:

RQ1: The detailed result files in RQ1, which are named by the format of [model]_[classifier].csv.

For example, the file named BERT_DT.csv in the folder Tian's_dataset means that this file is the result of patches from Tian's study embedded by BERT and classified by Decision Tree.

Tian's_dataset : The detailed result files on Tian's dataset.

Cache_dataset : The detailed result files on our own dataset.

Cross_dataset : The detailed result files of representation learning techniques when training on our own dataset and testing on Tian's dataset.

RQ2: The detailed result files in RQ2.

Wang_Cache.csv: The detailed result of Cache on the dataset from Wang's ASE20.

ODS_Cache.csv: The datailed result of Cache on the dataset from Xiong's ICSE18 paper. We directly compare against the results reported by the authors of ODS on 139 patches from Xiong's paper since the data and source code of ODS is unavailable.

Source: The source code and lib for running Cache is available at https://github.com/APR-Study/Cache.

https://assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/975541/Surge_testing_summary_2021-03-26.ods">https://www.gov.uk/assets/whitehall/pub-cover-spreadsheet-471052e0d03e940bbc62528a05ac204a884b553e4943e63c8bffa6b8baef8967.png">

Surge testing summary 1 April 2021

ODS, 8.75KB

 <p class="opendocument-help">
  This file is in an <a href="https://www.gov.uk/guidance/using-open-document-formats-odf-in-your-organisation" class="govuk-link">OpenDocument</a> format
 </p>

 <div data-module="toggle" class="accessibility-warning" id="attachment-5074041-accessibility-help">
  <p>This file may not be suitable for users of assistive technology.</p>
  <details class="gem-c-details govuk-details govuk-!-margin-bottom-3">

Request an accessible format.

   If you use assistive technology (such as a screen reader) and need a

version of this document in a more accessible format, please email publications@phe.gov.uk. Please tell us what format you need. It will help us if you say what assistive technology you use.

Work is underway in NHS Test and Trace to digitally label samples associated with surge testing, through an end-to-end process from sample to sequence. In the interim, this preliminary analysis uses a pragmatic proxy of samples identified through local surge testing initiatives as:

• specimens taken at a mobile test unit (MTU), regional test site (RTS) or local test site (LTS) that has been designated by NHS Test and Trace as related to surge testing, during the period surge testing was in operation PLUS

• specimens from a home test kit delivered to a postcode within a designated surge test area, during the period surge testing was in operation

Tests undertaken as part of surge testing but from persons resident in other postcodes or processed through a test site not designated as surge testing using the definition above, will not be included in this proxy.

Indicators are presented by ‘locality’ of area targeted for surge testing and the test sites linked to it (including MTU deployment). Locality names are the operational names assigned by Test and Trace and do not necessarily relate to strict geographical boundaries. Specimens from individuals who do not reside in the locality – but who have been tested at a site associated with the locality for surge testing – may be included.

All variant of concern or variant under investigation samples identified through surge testing are verified through established PHE dataflows and matched to the earliest positive specimen of a case in the daily line list of cases. Therefore, this report does not include sequencing for any cases with a positive specimen taken prior to surge testing. Data from the last 7 days has been excluded to allow time for sequencing data to be reported.

Lateral Flow Device (LFD) testing and cases first identified using LFD are included. Cases first identified using LFD may have a later PCR sample which has been sequenced. LFD contribution to case rate is assumed to be similar in surge and non-surge areas and therefore should not impact comparative sequencing estimates.<

Percentage of emergency admissions to any hospital in England occurring within 30 days of the last, previous discharge from hospital after admission; indirectly standardised by age, sex, method of admission and diagnosis / procedure. Admissions for cancer and obstetrics are excluded. October 2022: This is the last CCGOIS publication. All Clinical Commissioning Groups (CCGs) were statutorily abolished on the 1 July 2022, and from this point all statutory obligations are managed by the Integrated Care Boards (ICBs). ICBs were established as statutory bodies from July 2022 and succeed Sustainability and Transformation Partnerships (STPs). These came into effect on 1 July 2022. A transition phase has been implemented from 1 July 2022, during which the 106 Organisation Data Service (ODS) codes that identified CCGs will be temporarily retained, but the names will be changed to identify the ‘Sub ICB Location’. February 2021: There is an ongoing review by NHS Digital of Emergency Readmissions which includes indicators across the frameworks. Phase Two of the review has been on hold during the pandemic although we hope re-start this work during 2021. During the review this indicator is designated as an experimental statistic. Experimental statistics are official statistics which are published in order to involve users and stakeholders in their development and as a means to build in quality at an early stage. Please see the methodological change paper and new specification, linked below, for more details. Legacy unique identifier: P01845