APC, Vertiv/Liebert and other Tier 1 UPS manufacturers already offer LiFePO4 options (at a significant premium) so the chemistry itself is known to be safe.
It’s always possible that a careless manufacturer makes a design that is bad but that is also a risk with SLA.
One thing to look out for is the certifications that a product has gone through. For example Goldmate is a pretty widely advertised LiFePO4 battery and UPS vendor and they clearly say that their batteries have industry certifications. But they have not published certification of their UPS product enclosing those batteries in the early models that I saw when I was shopping..
Is that a sign their UPS is unsafe? No, it’s an absence of indicators.
Alternately, you could put intended LiFePO4 batteries in your existing APC, many of them are designed to imitate SLA batteries to the charging unit. But you do need to be sure they are designed for that role rather than expecting a Lithium capable charger.