Any open-source object layout and connection libraries?

I'm looking for an open-source software library or plugin that provides an interface similar to Visio, Umbrello, Dia, Inkscape, Xilinx ISE, etc. which allows the creation of objects and connections by users, which can then be yzed by the caller program. Ideally this would be a cross-platform library, but it needs to work on Linux.