If you do that, please make it a configure option. It will be treated like the other libraries, which I believe do have configure options to disable building with them.