Large Language Models for Detecting CONSORT Guideline Compliance in Published Randomized Clinical Trials: A Cross-Sectional Evaluation Study - Dataset

Num 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 Article De Santis O, Audran R, Pothin E, et al. Safety and immunogenicity of a chimpanzee adenovirus-vectored Ebola vaccine in healthy adults: a randomised, double-blind, placebo-controlled, dose-finding, phase 1/2a study. Lancet Infect Dis. 2016;16(3):311-320. doi:10.1016/S1473-3099(15)00486-7 Haller MJ, Atkinson MA, Wasserfall CH, et al. Mobilization without immune depletion fails to restore immunological tolerance or preserve beta cell function in recent onset type 1 diabetes. Clin Exp Immunol. 2016;183(3):350-357. doi:10.1111/cei.12731 Fischer K, Bahlo J, Fink AM, et al. Long-term remissions after FCR chemoimmunotherapy in previously untreated patients with CLL: updated results of the CLL8 trial. Blood. 2016;127(2):208-215. doi:10.1182/blood-2015-06-651125 Beachler DC, Kreimer AR, Schiffman M, et al. Multisite HPV16/18 Vaccine Efficacy Against Cervical, Anal, and Oral HPV Infection. J Natl Cancer Inst. 2015;108(1):djv302. Published 2015 Oct 14. doi:10.1093/jnci/djv302 Rapaport MH, Nierenberg AA, Schettler PJ, et al. Inflammation as a predictive biomarker for response to omega-3 fatty acids in major depressive disorder: a proof-of-concept study. Mol Psychiatry. 2016;21(1):71-79. doi:10.1038/mp.2015.22 Landin H, Mörk MJ, Larsson M, Waller KP. Vaccination against Staphylococcus aureus mastitis in two Swedish dairy herds. Acta Vet Scand. 2015;57:81. Published 2015 Nov 25. doi:10.1186/s13028-015-0171-6 Raatz SK, Johnson LK, Picklo MJ. Consumption of Honey, Sucrose, and High-Fructose Corn Syrup Produces Similar Metabolic Effects in Glucose-Tolerant and -Intolerant Individuals. J Nutr. 2015;145(10):2265-2272. doi:10.3945/jn.115.218016 Genovese MC, Hsia E, Belkowski SM, et al. Results from a Phase IIA Parallel Group Study of JNJ-40346527, an Oral CSF-1R Inhibitor, in Patients with Active Rheumatoid Arthritis despite Disease-modifying Antirheumatic Drug Therapy. J Rheumatol. 2015;42(10):1752-1760. doi:10.3899/jrheum.141580 Ma JK, Drossard J, Lewis D, et al. Regulatory approval and a first-in-human phase I clinical trial of a monoclonal antibody produced in transgenic tobacco plants. Plant Biotechnol J. 2015;13(8):1106-1120. doi:10.1111/pbi.12416 Mily A, Rekha RS, Kamal SM, et al. Significant Effects of Oral Phenylbutyrate and Vitamin D3 Adjunctive Therapy in Pulmonary Tuberculosis: A Randomized Controlled Trial. PLoS One. 2015;10(9):e0138340. Published 2015 Sep 22. doi:10.1371/journal.pone.0138340 Bhatia A, Sharma RK, Tewari S, Narula SC. A randomized clinical trial of salivary substitute as an adjunct to scaling and root planing for management of periodontal inflammation in mouth breathing patients. J Oral Sci. 2015;57(3):241-247. doi:10.2334/josnusd.57.241 Andres C, Plana M, Guardo AC, et al. HIV-1 Reservoir Dynamics after Vaccination and Antiretroviral Therapy Interruption Are Associated with Dendritic Cell Vaccine-Induced T Cell Responses. J Virol. 2015;89(18):9189-9199. doi:10.1128/JVI.01062-15 Debrah AY, Specht S, Klarmann-Schulz U, et al. Doxycycline Leads to Sterility and Enhanced Killing of Female Onchocerca volvulus Worms in an Area With Persistent Microfilaridermia After Repeated Ivermectin Treatment: A Randomized, Placebo-Controlled, Double-Blind Trial. Clin Infect Dis. 2015;61(4):517-526. doi:10.1093/cid/civ363 Hunter DJ, Beavers DP, Eckstein F, et al. The Intensive Diet and Exercise for Arthritis (IDEA) trial: 18-month radiographic and MRI outcomes. Osteoarthritis Cartilage. 2015;23(7):1090-1098. doi:10.1016/j.joca.2015.03.034 Nilsson C, Hejdeman B, Godoy-Ramirez K, et al. HIV-DNA Given with or without Intradermal Electroporation Is Safe and Highly Immunogenic in Healthy Swedish HIV-1 DNA/MVA Vaccinees: A Phase I Randomized Trial. PLoS One. 2015;10(6):e0131748. Published 2015 Jun 29. doi:10.1371/journal.pone.0131748 Lo MM, Mbao V, Sierra P, et al. Safety and immunogenicity of Onderstepoort Biological Products' Rift Valley fever Clone 13 vaccine in sheep and goats under field conditions in Senegal. Onderstepoort J Vet Res. 2015;82(1):857. Published 2015 May 29. doi:10.4102/ojvr.v82i1.857 Fuchs CS, Azevedo S, Okusaka T, et al. A phase 3 randomized, double-blind, placebo-controlled trial of ganitumab or placebo in combination with gemcitabine as first-line therapy for metastatic adenocarcinoma of the pancreas: the GAMMA trial. Ann Oncol. 2015;26(5):921-927. doi:10.1093/annonc/mdv027 Joachim A, Nilsson C, Aboud S, et al. Potent functional antibody responses elicited by HIV-I DNA priming and boosting with heterologous HIV-1 recombinant MVA in healthy Tanzanian adults. PLoS One. 2015;10(4):e0118486. Published 2015 Apr 14. doi:10.1371/journal.pone.0118486 Wheatley CM, Baker SE, Morgan MA, et al. Effects of exercise intensity compared to albuterol in individuals with cystic fibrosis. Respir Med. 2015;109(4):463-474. doi:10.1016/j.rmed.2014.12.002 Treven P, Mrak V, Bogovič Matijašić B, Horvat S, Rogelj I. Administration of probiotics Lactobacillus rhamnosus GG and Lactobacillus gasseri K7 during pregnancy and lactation changes mouse mesenteric lymph nodes and mammary gland microbiota. J Dairy Sci. 2015;98(4):2114-2128. doi:10.3168/jds.2014-8519 LLM: Claude Sonnet 4 DOI 1a 1b 2a 2b 3a https://doi.org/10.1016/S1473-3099(15)00486-7 Yes Yes Yes Yes Yes https://doi.org/10.1111/cei.12731 No Yes Yes Yes Partially https://doi.org/10.1182/blood-2015-06-651125 Partially Yes Yes Yes Yes https://doi.org/10.1093/jnci/djv302 Yes Yes Yes Yes Yes https://doi.org/10.1038/mp.2015.22 Yes Yes Yes Yes Yes https://doi.org/10.1186/s13028-015-0171-6 No No Yes Yes Yes https://doi.org/10.3945/jn.115.218016 No Partially Yes Yes Partially https://doi.org/10.3899/jrheum.141580 Yes Yes Yes Yes Yes https://doi.org/10.1111/pbi.12416 Yes Yes Yes Yes Partially https://doi.org/10.1371/journal.pone.0138340 Yes Yes Yes Yes Yes https://doi.org/10.2334/josnusd.57.241 Yes Yes Yes Yes Yes https://doi.org/10.1128/JVI.01062-15 No Partially Yes Yes Yes https://doi.org/10.1093/cid/civ363 Yes Yes Yes Yes Yes https://doi.org/10.1016/j.joca.2015.03.034 Yes Yes Yes Yes Yes https://doi.org/10.1371/journal.pone.0131748 Yes Yes Yes Yes Yes https://doi.org/10.4102/ojvr.v82i1.857 No Partially Yes Yes Yes https://doi.org/10.1093/annonc/mdv027 Yes Yes Yes Yes Yes https://doi.org/10.1371/journal.pone.0118486 Yes Yes Yes Yes Yes https://doi.org/10.1016/j.rmed.2014.12.002 No Yes Yes Yes Yes https://doi.org/10.3168/jds.2014-8519 No Yes Yes Yes Yes 3b 4a 4b 56a 6b 7a 7b 8a No Yes Yes Yes Yes No Yes Partially Yes No Yes Yes Yes Yes No No No No No Yes Yes Yes Yes No Yes No No No Yes Yes Yes Yes No No No No No Yes Yes Yes Yes No Yes No Partially No Yes Yes Yes Yes No No No No No Yes Yes Yes Yes No Partially No Partially No Yes Yes Yes Yes No Yes No Yes No Yes Yes Yes Yes No No No Partially Partially Yes Yes Yes Yes No Yes No Yes No Yes Yes Yes Yes No Yes No Yes No Yes Partially Yes Yes No No No No No Yes Yes Yes Yes No Yes No Yes No Yes Yes Yes Yes No No No No No Yes Yes Yes Yes No Yes Partially No No Yes Yes Yes Yes No No No No No Yes Yes Yes Yes Yes Yes Yes Yes No Yes Yes Yes Yes No Yes No No No Yes Yes Yes Yes No No No No No Yes Yes Yes Yes No No No No 8b 910 11a 11b 12a 12b 13a 13b Yes Yes Yes Yes Yes Yes Yes Yes Yes Partially No No Partially Yes Yes Yes Partially Partially No No No Yes No Yes Yes Yes Yes No No No Yes No Yes Yes Yes Yes No Partially Partially Partially No Yes Yes Yes Yes No No No No No Yes Yes Partially Yes No Partially No Partially Partially Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes No Partially Partially Yes Yes No No Yes Yes Yes Yes Partially Yes Yes Yes Yes Yes Yes Yes Partially Partially Yes No Yes Partially Yes Yes Yes No No Yes No Yes Yes Yes No Yes Yes Yes Yes Yes Yes Yes Yes Yes No No No No No Yes Yes Yes Yes Partially Yes Yes Yes Yes Yes Yes Yes Yes No No No Yes Partially Yes No Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes No No No Partially Yes Yes Yes Partially No No No No No No Yes No Yes Yes No No No No No Yes No Yes Yes 14a 14b 15 16 17a 17b 18 19 20 Yes No Yes Yes Yes Partially Yes Yes Yes No No Yes Partially Partially No Partially Yes Yes Yes No Yes Yes Yes No No Yes Yes Yes No Yes Yes Yes Partially Yes No Yes Yes No Yes Yes Yes No Partially No Yes Yes No Yes Yes Yes Yes Yes No Yes Yes No Yes Yes Yes No Partially Yes Yes Yes Yes Yes Yes Yes Partially Yes Yes Yes Yes No No No No No No Yes Partially Yes No Yes Yes Yes Partially Yes Yes Yes Partially Yes Yes Yes Yes No No No Yes No No Yes Yes Yes No Yes No Yes No No Yes Yes Yes No Yes Yes Yes Yes No Yes Yes Yes No No No Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes Yes No Yes Yes Yes No No No Partially Yes Yes Yes Yes Yes Partially Yes Yes Yes No No No Partially Partially No Yes No Partially Yes No Yes Yes Yes Yes No Yes Yes Yes No Yes Yes Yes No No No Yes sem 1.28 1.22 0.55 -3% std 5.72 5.44 2.45 -15% avg 23.65 10.60 2.70 -68% 21 22 23 24 25 YES NO PARTIALLY Count CLAUDE Yes Yes Yes No Yes 31 4 2 37 86.50% Yes Yes No No Yes 16 13 837 54.10% Yes Yes No Yes Yes 24 12 137 66.20% Yes Yes Yes No Yes 24 12 137 66.20% Yes Yes No No Yes 22 10 537 66.20% Yes Yes No No Yes 20 16 137 55.40% Yes Yes Yes Yes Yes 21 8 8 37 67.60% Yes Yes Yes Partially Yes 32 3 2 37 89.20% Yes Yes Yes No Yes 18 14 537 55.40% Yes Yes Yes No Yes 30 4 3 37 85.10% Yes Yes No No Yes 24 9 4 37 70.30% Yes Yes Yes No Yes 20 15 237 56.80% Yes Yes Yes No Yes 30 7 0 37 81.10% Yes Yes No No Yes 21 16 037 56.80% Yes Yes Yes Yes Yes 32 3 2 37 89.20% Yes Yes No No Yes 18 16 337 52.70% Yes Yes Yes Partially Yes 34 1 2 37 94.60% Yes Yes Yes Yes Yes 19 13 537 58.10% Yes No No No 19 17 036 51.40% Yes Yes No No No 18 19 037 48.60% 2% 3% 2% 5% 10% 0% 4% 9% 15% 17% 22% 44% 0% 30% 81% 55% 68% 5% 25% 0% 10% CHATGPT GEMINI COMBINED >90% >90% >90% COMBINED 94.60% 75.70% - 0 1 0 - 75.70% 44.40% - 0 0 0 - 78.40% 58.30% - 0 0 0 - 75.70% 54.10% - 0 0 0 - 75.70% 51.40% - 0 0 0 - 59.50% 35.10% - 0 0 0 - 83.80% 35.10% - 0 0 0 - 81.10% 51.40% - 0 0 0 - 77.00% 51.40% - 0 0 0 - 75.70% 51.40% - 0 0 0 - 78.40% 40.50% - 0 0 0 - 81.10% 39.20% - 0 0 0 - 83.80% 83.80% - 0 0 0 - 86.50% 54.10% - 0 0 0 - 90.50% 78.40% - 0 1 0 - 73.00% 64.90% - 0 0 0 - 94.60% 78.40% - 1 1 0 - 93.20% 58.10% - 0 1 0 - 90.50% 56.80% - 0 1 0 - 70.30% 39.20% - 0 0 0 -