Independently of how well the feature does (or doesn't) work, this is problematic.
Given that generative AI is strictly prohibited, it seems rather... inconsistent to forbid it on the one hand and to offer it as a feature on the other hand. This is a strongly mixed message that will likely encourage people to post even more AI-generated content. (It's hard to offer that as a site feature and then turn around and pretend to be serious about any kind of ban).
This proposed feature is ill-timed in light of the moderation strike that's going on. On the one hand, SE forbids us from enforcing the policy against generative AI, and then they turn around and present generative AI as a feature.
