Yes, open-loop systems can be unstable (examples below, there's innumerable ones).
"Open loop" can be a fuzzy term, and if there was a pitcher of beer on the line I could prove that any unstable system "has internal feedback, now gimme that beer".
The first real ground truth is that natural as-found systems can be stable or not.
The second real ground truth (and possibly what was misleading that first engineer) is that with open-loop control we cannot change the stability properties of a system -- you have what you have. In the case of some nonlinear systems you can avoid unstable operating points, but you can't make the system operate at such a point for any length of time, because it's unstable.
The third real ground truth is that with closed-loop control we can change the stability properties of a system: we can make a stable system unstable, or with active control we can make an unstable system stable (both of my examples below can be stabilized, BTW).
Examples
Find the nearest broom, place it vertically on the floor with the stick on the floor and the broomhead up. Let go.
Up until the moment that it smacks into the floor and stops moving, that's an unstable system, and it's operating in open loop. You can tell it's open-loop by writing the differential equations for its motion. If you ignore friction, air resistance (and the floor), and if you linearize the equations around the operating point, you'll see that it has two modes: \$e^{-at}\$ and \$e^{+at}\$ (i.e., it has poles at \$s = \pm a\$). That second mode is unstable.
Find the nearest NPN power transistor. Put it in a circuit with a healthy (for it) voltage on the collector, and bias it with a fixed voltage to flow a healthy (for it) current from collector to emitter.
In the absence of a truly massive heat sink, as it flows current, it'll heat up. As it heats up, it'll flow more current. That'll make it heat up more. While the precise dynamic equation is both complicated and nonlinear, if you simplify it and linearize it then the dominant behavior will once again be an unstable 1st-order response of \$e^{+at}\$.