We are attached to the concept of "Who made it" because we reason from a meritocratic perspective. I did most of the work, so I should get the credit. The entire reason because the copyright norms exist is to push innovation.
We are asking here if we could use some product to implement a modification on it, making it better, worse or just different.
We should be clear that this is what we are doing, but we should be able to innovate using things from the past once the people who made it are gone.
Not all Ai use should be permitted but the question underlines the possibility of at least one permitted use, and I think this use should exist if agreed before or enough time passed (and in absence of a direct prohibition from the author). Humans keep taking things from the past and construct on top of it, this is not different.