As with any application, you should always have a close look at the Terms of Use and Privacy Policy of the AI tool you are using, so you have an understanding about the service, what you're allowed to do, and what happens with any data you provide. For example, OpenAI's (ChatGPT) Terms of Use and Privacy Policy, state:
Terms of Use
- If you are "under 18 you must have your parent or legal guardian’s permission to use the Services" (Registration and Access section)
- You are "responsible for all activities that occur using your credentials" (Registration and Access section)
- You must not "represent that output from the Services was human-generated when it is not" (Usage Requirements section)
- this means that any content created using ChatGPT that you submit for your assignment must be identified as having been created by ChatGPT
- The output that is generated "may not be unique" (Content section)
- The output that is generated "may in some situations result in incorrect Output that does not accurately reflect real people, places, or facts" (Content section)
- You should "evaluate the accuracy of any Output as appropriate for your use case, including by using human review of the Output" (Content section)
Privacy Policy
- OpenAI collects personal information you provide. This includes your name, contact info, payment info, files you upload, messages you send, and activities on related social media accounts
- OpenAI collects personal information automatically when you use the service. This includes log data (your IP address, date, etc.), usage data (what you did), device information (what you used), and cookies (websites you visited)
- OpenAI states that they "may provide your Personal Information to third parties without further notice to you". These third parties include vendors, other providers, law enforcement, and affiliates.
This means that your personal information is not private and may be shared for commercial or legal purposes. This likely applies to other AI tools in a very similar way.