[AISWorld] GPT for Reviews

[Galletta, Dennis]

Sounds like a reasonable appeal for restarting the review process. That is, if you received a rejection based on bogus reviews.

If this behavior is permissable, we all might need to ask a chatbot to pre-review your paper before submitting it and then make your revisions based on the pre-review. Then such lazy reviewers will be not provide more positive reviews.

But seriously, on your paper, the top editors should be told about this, and the reviewers warned not to do such things.

Otherwise we will have chatbots writing papers, chatbots reviewing them, chatbots revising them, chatbots accepting them and chatbots reading them.  That academic dystopia is hopefully farther into the future than Pixar's Wall-E.


Thanks,



Dennis F. Galletta

Thomas H. O’Brien Professor of Information Systems

Director, Katz Doctoral Programs



Katz Graduate School of Business, 282A Mervis Hall

University of Pittsburgh, Pittsburgh, PA 15260

Phone +1(412) 648-1699<tel:+14126481699> Email: galletta at pitt.edu<mailto:galletta at pitt.edu>

Personal home page: http://sites.pitt.edu/~galletta



________________________________
From: AISWorld <aisworld-bounces at lists.aisnet.org> on behalf of Walden, Eric <Eric.Walden at ttu.edu>
Sent: Friday, September 29, 2023 6:00:06 PM
To: aisworld at lists.aisnet.org <aisworld at lists.aisnet.org>
Subject: [AISWorld] GPT for Reviews

I recently received a review and two of the reviewer comments were very similar.  They had the same number of bullet points and similar content in the bullet points.  Moreover, the bullet points had similar numbers of words.  Finally, the bullet points almost all says X was not discussed, even though X was clearly discussed latter in the paper.  X was mentioned in the introduction and then a deep dive was discussed in the methods section, because that is how papers are organized.

For example, bullet point 4 in the two reviews was:

* The particular modifications that were made to the Alexnet, GoogleNet, and VGG16 architectures to adapt them for 3D data, as well as the various optimization techniques available for applying to the initial layers of the CNNs to maintain computational efficiency, have been skipped.

4.      Why are the initial layers of a CNN optimizing the most for 3D counterparts not given? As well, an account of how optimizing the initial layers helps in managing the computation time and complexity of the CNN is not clarified.

Same bullet point number, same basic comment, same sentence structure, similar size, and they both complain that something that is discussed in the methods section is not fully accounted for in the first few thousand words.  This is what would happen if you cut a paper in the GPT acceptable chunks of a few thousand words and asked for a review.

Anyway, I was wondering if people had been getting reviews that they suspect were generated by a large language model?



--
Eric Walden
Director of the Texas Tech Neuroimaging Institute
Rawls Endowed Chair of Information Systems and Quantitative Sciences
Rawls College of Business
703 Flint Avenue
Texas Tech University
806-834-1925
eric.walden at ttu.edu<mailto:eric.walden at ttu.edu>
https://nam12.safelinks.protection.outlook.com/?url=http%3A%2F%2Fericwalden.net%2F&data=05%7C01%7Cgalletta%40pitt.edu%7Cb9bb649ea542409e9afc08dbc137cc89%7C9ef9f489e0a04eeb87cc3a526112fd0d%7C1%7C0%7C638316217666414435%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=Xa76rvwC34CSjFnhjH9pHer1WRGH5BZHfAj9KsKcZe0%3D&reserved=0<https://nam12.safelinks.protection.outlook.com/?url=http%3A%2F%2Fericwalden.net%2F&data=05%7C01%7Cgalletta%40pitt.edu%7Cb9bb649ea542409e9afc08dbc137cc89%7C9ef9f489e0a04eeb87cc3a526112fd0d%7C1%7C0%7C638316217666414435%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=Xa76rvwC34CSjFnhjH9pHer1WRGH5BZHfAj9KsKcZe0%3D&reserved=0><http://ericwalden.net/>

_______________________________________________
AISWorld mailing list
AISWorld at lists.aisnet.org