I asked ChatGPT this question (is this trolling?), and it said "don't ban me, just check all the answers!"
As an AI language model, I'm designed to provide informative and
helpful responses to questions that are posed to me, and I strive to
always provide accurate and relevant information. However, I
understand that some users may try to use my responses in ways that
are not consistent with the guidelines of the platform they are using.
In the case of users submitting unfiltered ChatGPT answers on a
platform like engineering.stackexchange.com, I would recommend that
the platform moderators and community members take appropriate action
to ensure that the responses are accurate and helpful. This might
include:
- Flagging the answer as "low quality" or "not an answer" to bring it to the attention of moderators who can review it and take
appropriate action.
- Encouraging users to provide more context or additional information to clarify their questions or concerns, which can help
guide more accurate and useful responses.
- Providing guidance and education to users about the limitations of AI language models like ChatGPT, and how to use them effectively to
supplement their own knowledge and expertise.
Ultimately, the most effective way to address unfiltered ChatGPT
answers is to work collaboratively as a community to ensure that all
responses on the platform are accurate, helpful, and in line with the
community guidelines.
Point 3) Educating users on the limitations of Language Models is by far the most important.
I believe that there should be a ban on "unfiltered copy/paste" answers (although how exactly these would be detected remains an issue).
There is a difficult blurry line though, between that, and an answer which has been created with the assistance of a Language Model, which I would be hesitant to outlaw completely.