GROW$^2$: Grounding Which and Where for Robot Tool Use

Can the robot use a plate to cut a cake if no knife is available?

Can the robot use a plate to cut a cake if no knife is available? Tool use greatly expands robot capabilities, but to use tools creatively beyond their intended functions, the robot faces the challenge of $\textit{open-world affordance grounding}$: select an open-category object…