Question here opened the discussion on FPGAs on robotics applications. I would like to teach a LSTM RNN/CNN on border detection and feature detection on FPGA. Feature detection methods I would like to have contain image morphology algorithms and basic ML algorithms to start with.

What are the most common machine learning libraries or deep learning algorithms to be used on FPGAs? Is it feasible to use traditional ML libraries such as H2O on FPGAs?


I cannot comment on 'most common', but I can definitely share several tools and research efforts towards using FPGA for deep-learning. See my survey paper on FPGA-based accelerators for CNN which reviews 75+ recent papers. Some of these research projects have released their code, such as DNNWeaver. Also, see tools from companies such as Xilinx. Finally, see the code of top FPGA entries at DAC-System-Design-Contest 2018. This contest features embedded system implementation of neural network based object detection for drones.

FPGA development takes time and hence, sometime it may not catch up with the pace of progress in machine learning. Also, unlike tools such as caffe, tensor-flow etc., which are supported by big universities/companies/open-source-communities, a research group alone cannot take their tool/idea to product/maturity-stage. Hence, FPGA development tools are not so numerous as is the case for GPU/CPU. So, I believe understanding "key research ideas" is also important and my answer on state-of-the-art research/academic proposals has some value and others can add different answers.

| improve this answer | |
  • $\begingroup$ Thanks for your answer but we are looking for comprehensive answers that provide some explanation and context. Very short answers cannot do this, so please edit your answer to explain why it is right. Additionally, we prefer answers to be self contained where possible. link only answers are frowned upon (as links tend to rot) & will be rendered useless if the linked-to content disappears. If you add more context and detail from the link, it is more likely that people will find your answer useful. $\endgroup$ – Greenonline Oct 7 '18 at 8:02
  • $\begingroup$ @Greenonline Sure, I will do as you suggested, in a day. Thanks a lot. $\endgroup$ – user984260 Oct 8 '18 at 9:02

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.