Link preview
EMNLP: All of the papers in my review pool being detected as AI [D]
https://preview.redd.it/elmu1a6d0kbh1.png?width=900&format=png&auto=webp&s=b4fd33a32c378d9a5df48f171bfb49af7623c224 Hey, Last week after I was done reviewing the papers I had for EMNLP I wanted to see how Pangram would evaluate them, and now after a quick search for those papers I noticed they were from some big labs with a lot of authors too. Seeing all of the papers receive a 100% on Pangram was quite interesting. I thought I'd share it here. My research interests are definitely not in AI text detection so my opinion would be rudimentary on it, but as fellow researcher do you really value something like Pangram that misfires a lot and using it for evaluating research work seems quite unfair. I say this in relation to the recent NeurIPS and Pangram collaboration. On the other hand, me and my lab mates each found a paper with hallucinated references which were promptly returned for desk rejects. This case I rightfully think is plain research negligence and should be handled with harsh methods. I'd honestly love to see what everyone thinks about this situation as I'm still not very experienced when it comes to such scenarios. submitted by /u/LordVein05 [link] [Kommentare] reddit.com · reddit.com
https://preview.redd.it/elmu1a6d0kbh1.png?width=900&format=png&auto=webp&s=b4fd33a32c378d9a5df48f171bfb49af7623c224 Hey, Last week after I was done reviewing the papers I had for EMNLP I wanted to see how Pangram would evaluate them, and now after a quick search for those papers I noticed they were from some big labs with a lot of authors too. Seeing all of the papers receive a 100% on Pangram was quite interesting. I thought I'd share it here. My research interests are definitely not in AI text detection so my opinion would be rudimentary on it, but as fellow researcher do you really value something like Pangram that misfires a lot and using it for evaluating research work seems quite unfair. I say this in relation to the recent NeurIPS and Pangram collaboration. On the other hand, me and my lab mates each found a paper with hallucinated references which were promptly returned for desk rejects. This case I rightfully think is plain research negligence and should be handled with harsh methods. I'd honestly love to see what everyone thinks about this situation as I'm still not very experienced when it comes to such scenarios. submitted by /u/LordVein05 [link] [Kommentare]
Comments