I think "intelligence" and "mimicry" are different. the larger question of whether "it" knows "its" doing these things is a largely unappreciated one. Does AlphaGo "appreciate" go? does Deep blue appreciate chess? what we have is advanced mimicry of intelligence - perhaps a better question to ask is "does a very very very good painting or model of a person become a person? anyway the whole strong AI discussion is moot since it's not a question of "if" but "when" and the concerns of "old scientists" will be taken into consideration.

What makes a person? What's consciousness?

I think we're beyond mimicry.

Not true. Mimicry is possible without definition.

A child will mimic parent's behavior without defining the behavior. For example, children of a parent with bipolar condition will tend to be bipolar through behavioral learning. And by the way learning doesn't require definition or consciousness.

Building human traits into robots and AI. That's what AI has always been about.

definition is about distillation to component forms - it can be conscious or unconscious . for example - smiling or raising your hand is all about muscle movement and the child observes and distills this and replicates it - they don't get it right 1st time but they train their faculties into mastering what they see. Grasping - motor skills. All complex behaviour that we mimicked our parents were small movements that we mastered and learnt how to stitch them into complex movements.