About me

I earned my Bachelor of Mathematics degree from Northeastern University (China) in 2022. I am currently pursuing a direct Ph.D. at the School of Mathematical Sciences and the Institute of Natural Sciences, Shanghai Jiao Tong University. My research centers on deep learning, with a special emphasis on Deep Reinforcement Learning and its applications (combined with LLM). Additionally, I have a keen interest in Machine Learning algorithms and theories.

Other Homepage

Welcome to my homepage! I have authored several blogs covering topics in Machine Learning, Reinforcement Learning, and Mathematics, which you can explore on my CSDN profile: CSDN. For a comprehensive look at my academic contributions, please visit my Google Scholar profile here: Google Scholar.

Intern for Machine Learning

1. Baidu (China) Knowledge Graph Department : (1) I utilized Reinforcement Learning to fine-tune the ERNIE Model, I mainly focus on how to fine-tune ENIRE using reinforcement learning based on a user-provided prompt. (2) I addressed a large-scale path planning problem, mainly focus on the Capacitated Vehicle Routing Problem (CVRP), and using multimodal training with Reinforcement Learning.
2. Microsoft Research Asia Ai4Science department： (1) I implemented training and application of the DPO model for additional tasks based on the SFT Llama7B model.

Mathematical Modeling and Data Science Competitions

1. First Prize, Mathematical Modeling Contest, Yangtze River Delta Region, 2022.
2. Second Prize, Shuwei Cup International Undergraduate Modeling Contest, 2021.
3. Third Prize, National Big Data Competition for Chinese Universities, 2021.
4. Second Prize, National Mathematical Modeling Contest (Provincial), 2021.
5. Third Prize, National Mathematical Modeling Contest (Provincial), 2020.
6. Second Prize, National Undergraduate Mathematics Contest (Provincial), 2019.
7. Third Prize, National Undergraduate Mathematics Contest, 2019.

Academic Scholarships and Recognitions:

1. Outstanding Graduate of Liaoning Province, 2022.
2. First Class Honor Scholarship, Northeastern University, 2019-2020.
3. Second Class Honor Scholarship, Northeastern University, 2021-2022.
4. First Class Named Honors Scholarship, Northeastern University, 2020.
5. Second Class Named Honors Scholarship, Northeastern University, 2019.
6. Outstanding Student, Northeastern University, 2019-2022.

Publications

1. (2024) Shen Y, Lv O, Zhu H, et al. ProteinEngine: Empower LLM with Domain Knowledge for Protein Engineering. 22nd International Conference on Artificial Intelligence in Medicine paper
2. (2024) Lv O, Zhou B, Yang L F. Modeling Bellman-error with logistic distribution with applications in reinforcement learning. Neural Networks, 2024, 177: 106387. paper
3. (2023) Zhou B, Zheng L, Wu B, et al. Protein engineering with lightweight graph denoising neural networks. Journal of Chemical Information and Modeling, 2023. paper
4. (2023) Lv O, Zhou B, Wang J, et al. A unified view on neural message passing with opinion dynamics for social networks. arXiv preprint arXiv:2310.01272, 2023. paper
5. (2023) Zhou B, Lv O, Yi K, et al. Accurate and Definite Mutational Effect Prediction with Lightweight Equivariant Graph Neural Networks. arXiv preprint arXiv:2304.08299, 2023. paper
6. (2022) Zhou B, Lv O, Yi K, et al. Lightweight Equivariant Graph Representation Learning for Protein Engineering. NeurIPS workshop on Machine Learning in Structural Biology, 2022 paper

If you have any questions or require further information, please feel free to contact me via email at: harry_lv@sjtu.edu.cn.