Group photo of the Architecture team

Architecture team

Research

The Architecture team studies methods for making more effective use of accelerators such as GPUs and FPGAs in massively parallel processing, networks for ultra-high-performance parallel processing, and high-performance parallel compilers that exploit them. We also believe that quantum computers, which have attracted much attention in recent years, may in the future become accelerators for particular classes of computation, and we are therefore studying development and execution environments for programs that use them. Under the collaboration agreement between the University of Tsukuba and the Global Research and Development Center for Business by Quantum-AI Technology (G-QuAT) of the National Institute of Advanced Industrial Science and Technology (AIST), research using G-QuAT’s state-of-the-art quantum computers is also possible. We further work on applying accelerators such as GPUs and FPGAs to high performance computing, and we welcome anyone interested in accelerating scientific computing applications or in the environments used to develop them. Research on advanced development methodologies and development environments (compilers and runtimes) is also under way. Our current main research topics are listed below. Tsuji and Fujita jointly supervise students as appropriate; this is a joint call by Professor Tsuji and Assistant Professor Fujita, with capacity for four students.

  • Software for coupling the supercomputers and the quantum computers operated by the University of Tsukuba
  • Optimisation of quantum computer simulators on supercomputers
  • Workflows for using a variety of supercomputers and quantum computers together
  • Research on combining computation offloading on FPGAs with high-speed communication
  • Research on optimising real applications using GPUs
  • Research on application development methodologies that support multiple GPU vendors
  • Research on parallel programming languages for GPU-FPGA clusters

Below we introduce the research topics our students are working on.

Implementing hardware that serialises multiple compressed streams

In recent years the ratio of computing speed to the memory bandwidth and communication bandwidth available in a computer has grown ever larger. As a result, many scientific computations cannot be supplied with data fast enough, and memory access and data communication frequently become the performance bottleneck. One way of addressing this is to raise the effective bandwidth by compressing the data.
In this research we use an FPGA (Field Programmable Gate Array) to implement hardware that sends each compressed data stream onto the communication path at a rate that accounts for its size before compression, thereby removing the imbalance in the amount of data delivered to each destination. This reduces the time spent waiting for data to arrive (stalls) in computations that depend on several data streams at once.
This work is carried out as part of a joint research project with RIKEN on adaptive compression hardware.

Professor Taisuke Boku (scheduled to retire at the end of FY2025)

  • Research on parallel processing architectures and networks that include accelerators such as GPUs
  • Research on parallel processing languages and compilers for using such systems efficiently
  • Research on improving the performance of massively parallel applications through joint work with developers of real applications

We study methods for making more effective use of accelerators such as GPUs and many-core processors in massively parallel processing, networks for ultra-high-performance parallel processing, and high-performance parallel compilers that exploit them. In the concept we have proposed, TCA (Tightly Coupled Accelerators), accelerators are connected to each other more quickly than conventional technology allows, and we develop the base technologies for efficient parallel processing on top of it. We also pursue practical large-scale applications together with researchers at the Center for Computational Sciences, University of Tsukuba, and, in joint work with Professor Mitsuhisa Sato of our cooperative graduate school programme, we collaborate with the next-generation massively parallel computer (post-K) project under way at RIKEN, advancing research on network simulation and on our own parallel processing languages and compilers.

Personal page

Professor Tsuji Miwako

  • Research on middleware for cooperative computation between quantum computers and supercomputers
  • Research on programming environments for cooperative computation between quantum computers and supercomputers

A quantum computer operates on principles drawn from quantum mechanics that differ from those of conventional computers, and it may be able to solve problems conventional computers are poor at. A supercomputer is the infrastructure that drives simulation, the third pillar of science. In order to explore new computational possibilities, we research and develop, from many angles, the software needed to use the two together.

Assistant Professor Norihisa Fujita

  • Research on accelerators such as GPUs and FPGAs , and on accelerating applications
  • Research on high-speed networks in high performance computing
  • Research on programming environments for exploiting the above

We research the use of accelerators such as GPUs and FPGAs in high performance computing. Beyond accelerating scientific computing applications with accelerators, we also work on the high-performance networks that interconnect computers and on direct FPGA-to-FPGA communication. In addition, we carry out research on system software, such as the programming environments needed to exploit these building blocks.

International activities

Professor Boku is active worldwide, serving as chair and program chair of the following international conferences.

  • Steering Committee Chair: HPC Asia
  • Steering Committee: IEEE Cluster
  • Steering Committee: ICPP
  • International Advisory Committee: HANAMI Europe-Japan Collaboration
  • Chair: 2023 ACM Gordon Bell Prize Committee
  • Committee Member (2021-2024): ACM Gordon Bell Prize Committee
  • General Co-Chair: IEEE Cluster 2025, Edinburgh
  • General Vice Co-Chair: IEEE Cluster 2024, Kobe
  • General Co-Chair: IEEE Cluster 2020, virtual
  • General Chair: ICPP2019, Kyoto

Professor Tsuji also takes on important roles such as general vice chair at several international conferences, and serves every year on the program committees of many of the major high performance computing conferences.

  • IEEE International Conference on Cluster Computing (CLUSTER2022), General Vice Chair
  • IEEE International Conference on Cluster Computing (CLUSTER2024), General Deupty Chair
  • The International Conference on High Performance Computing in Asia-Pacific Region (HPCAsia2022), General Vice Chair
  • The International Conference for High Performance Computing, Networking, Storage, and Analysis (SC25, 24, 23, 22, etc), Technical Program Committee member
  • IEEE/ACM International Symposium on Cluster, Cloud and Internet Computing Program Committee member (CCGRID25, 24, 23, 22, etc)
  • ISC High Performance (ISC25, 24, 23, 22, etc)
  • IEEE International Parallel and Distributed Processing Symposium (IPDPS25, 22)
  • International Conference on Parallel Processing (ICPP25, 24, 23, 22, etc)

Assistant Professor Fujita has also served on the program committees of several international conferences.

  • Special Session Chair, Performance Optimization and Auto-Tuning of Software on Multicore/Manycore Systems 2024
  • Member, ISC 2024 Workshop Committee
  • Publicity Chair, HPC Asia 2024 Organizing Committee

Collaboration with other teams

We work with the FPGA team on basic evaluation of FPGAs and on implementing parallel applications.

Members

Tsuji Miwako

Tsuji Miwako Professor

  • Quantum-HPC integration

Quantum computers work on principles completely different from those of computers so far, and by having them work together with supercomputers, we expect that computations which were impossible until now will become possible. I study the software for connecting quantum computers and supercomputers, as well as programming models for that integration. Using world-class supercomputers and cutting-edge quantum computers, let's do research together.

Norihisa Fujita

Norihisa Fujita Assistant Professor

  • GPU
  • FPGA
  • Accelerators

I do research on applying FPGAs to large-scale scientific and technical computing. Besides research on optimizing applications for FPGAs, I also work on using the fast external communication links of FPGAs to communicate between multiple FPGAs and compute large problems in parallel across them. Today's FPGAs have a high development cost and things rarely go smoothly, but FPGAs can do things that CPUs and other accelerators cannot, and I believe they are a device with a promising future. And above all, the sense of achievement and joy when a result finally comes out is something special. Recently I received the HPC in Asia poster award at an international conference held in Frankfurt. Our laboratory's research is highly regarded around the world in other areas too, so if you secretly think "I want to do something amazing and get the world's attention!", this lab is exactly the ideal environment. If you are even a millimeter interested, please come and visit us!

Takuto Shirai

Takuto Shirai M2

Tomo Yoshida

Tomo Yoshida M2

Takato Abe

Takato Abe M2

  • GPU

I am studying Nvidia GPUs so that I can do research on scientific and technical computing applications that use GPUs. In the lab you are taught the basics of parallel computing through OpenMP and OpenMPI, and at the meetings held almost every week you can take your questions straight to the professors, so you gain the deep understanding of parallel computing and accelerator devices that research in high performance computing requires. If you are interested in that kind of field, please come along to one of our information sessions.

Usami Kenta

Usami Kenta M1

Mikoto Igarashi

Mikoto Igarashi B4

Aoi Nakano

Aoi Nakano B4

Kanta Nakayama

Kanta Nakayama B4

Recent Works

  • Using Intel oneAPI for Multi-hybrid Acceleration Programming with GPU and FPGA Coupling
    • Liang, Wentao
    • Fujita Norihisa
    • Kobayashi Ryohei
    • Boku Taisuke
    Liang, W., Fujita, N., Kobayashi, R., & Boku, T. (2024, January). Using Intel oneAPI for Multi-hybrid Acceleration Programming with GPU and FPGA Coupling. In Proceedings of the International Conference on High Performance Computing in Asia-Pacific Region Workshops (pp. 69-76).
  • Improving Performance on Replica-Exchange Molecular Dynamics Simulations by Optimizing GPU Core Utilization
    • Taisuke Boku
    • Masataka Sugita
    • Ryohei Kobayashi
    • Shinnosuke Furuya
    • Takuya Fujie
    • Masahito Ohue
    • Yutaka Akiyama
    Taisuke Boku, Masataka Sugita, Ryohei Kobayashi, Shinnosuke Furuya, Takuya Fujie, Masahito Ohue, Yutaka Akiyama, “Improving Performance on Replica-Exchange Molecular Dynamics Simulations by Optimizing GPU Core Utilization”, Proc. of ICPP2024, Visby, Sweden, Aug. 15th, 2024.
  • Accelerating Radiative Transfer Simulation on NVIDIA GPUs with OpenACC
    • Ryohei Kobayashi
    • Norihisa Fujita
    • Yoshiki Yamaguchi
    • Taisuke Boku
    • Kohji Yoshikawa
    • Makito Abe
    • Masayuki Umemura
    Ryohei Kobayashi, Norihisa Fujita, Yoshiki Yamaguchi, Taisuke Boku, Kohji Yoshikawa, Makito Abe, Masayuki Umemura, "Accelerating Radiative Transfer Simulation on NVIDIA GPUs with OpenACC", PDCAT 2022: Parallel and Distributed Computing, Applications and Technologies, Volume 13798, pp.344 – 358, April 2023
  • A GPU+FPGA combined device processing system with a single OpenACC description
    • 綱島 隆太
    • 小林 諒平
    • 藤田 典久
    • 朴 泰祐
    • Lee Seyong
    • Vetter Jeffrey S.
    • 村井 均
    • 中尾 昌広
    • 辻 美和子
    • 佐藤 三久
    綱島隆太, 小林諒平, 藤田典久, 朴泰祐, 村井均, 中尾昌広, ... & 佐藤三久. (2023). A GPU+FPGA combined device processing system with a single OpenACC description. IPSJ Transactions on Advanced Computing Systems (ACS), 16(2), 1-15. (in Japanese)
  • CHARM-SYCL: New Unified Programming Environment for Multiple Accelerator Types
    • Norihisa Fujita
    • Beau Johnston
    • Ryohei Kobayashi
    • Keita Teranishi
    • Seyong Lee
    • Taisuke Boku
    • Jeffrey S. Vetter
    Norihisa Fujita, Beau Johnston, Ryohei Kobayashi, Keita Teranishi, Seyong Lee, Taisuke Boku, and Jeffrey S. Vetter, “CHARM-SYCL: New Unified Programming Environment for Multiple Accelerator Types,” In Proceedings of the SC '23 Workshops of The International Conference on High Performance Computing, Network, Storage, and Analysis (SC-W '23). Association for Computing Machinery, New York, NY, USA, pp. 1651–1661, Nov. 2023. doi: doi.org/10.1145/3624062.3624244
  • OpenACC Unified Programming Environment for Multi-hybrid Acceleration with GPU and FPGA
    • Boku Taisuke
    • Tsunashima Ryuta
    • Kobayashi Ryohei
    • Fujita Norihisa
    • Lee Seyong
    • Vetter Jeffrey S
    • Murai Hitoshi
    • Nakao Masahiro
    • Tsuji Miwako
    • Sato Mitsuhisa
    Boku, T. et al. (2023). OpenACC Unified Programming Environment for Multi-hybrid Acceleration with GPU and FPGA. In: Bienz, A., Weiland, M., Baboulin, M., Kruse, C. (eds) High Performance Computing. ISC High Performance 2023. Lecture Notes in Computer Science, vol 13999. Springer, Cham. https://doi.org/10.1007/978-3-031-40843-4_49
  • Implementation and Performance Evaluation of Memory System Using Addressable Cache for HPC Applications on HBM2 Equipped FPGAs
    • Fujita Norihisa
    • Kobayashi Ryohei
    • Yamaguchi Yoshiki
    • Boku Taisuke
    Fujita, N., Kobayashi, R., Yamaguchi, Y., Boku, T. (2023). Implementation and Performance Evaluation of Memory System Using Addressable Cache for HPC Applications on HBM2 Equipped FPGAs. In: Singer, J., Elkhatib, Y., Blanco Heras, D., Diehl, P., Brown, N., Ilic, A. (eds) Euro-Par 2022: Parallel Processing Workshops. Euro-Par 2022. Lecture Notes in Computer Science, vol 13835. Springer, Cham. https://doi.org/10.1007/978-3-031-31209-0_9
  • Accelerating Radiative Transfer Simulation on NVIDIA GPUs with OpenACC
    • Kobayashi Ryohei
    • Fujita Norihisa
    • Yamaguchi Yoshiki
    • Boku Taisuke
    • Yoshikawa Kohji
    • Abe Makito
    • Umemura Masayuki
    PDCAT 2022: Parallel and Distributed Computing, Applications and Technologies, 13798 344-358, Apr, 2023
  • A study on spatial parallelism description for improving computational performance in FPGA high-level synthesis
    • 佐野 由佳
    • 小林 諒平
    • 藤田 典久
    • 朴 泰祐
    • 佐藤 三久
    佐野 由佳, 小林 諒平, 藤田 典久, 朴 泰祐, 佐藤 三久: ”A study on spatial parallelism description for improving computational performance in FPGA high-level synthesis,” IPSJ SIG Technical Report, 188th HPC Meeting, Vol. 2023-HPC-188, No. 22, Jul 2023. (in Japanese)
  • Implementation and Performance Evaluation of Collective Communications Using CIRCUS on Multiple FPGAs
    • Kikuchi Kohei
    • Fujita Norihisa
    • Kobayashi Ryohei
    • Boku Taisuke
    Kohei Kikuchi, Norihisa Fujita, Ryohei Kobayashi, and Taisuke Boku. 2023. Implementation and Performance Evaluation of Collective Communications Using CIRCUS on Multiple FPGAs. In Proceedings of the HPC Asia 2023 Workshops (HPCAsia '23 Workshops). Association for Computing Machinery, New York, NY, USA, 15–23. https://doi.org/10.1145/3581576.3581602
  • GPU-FPGA-accelerated Radiative Transfer Simulation with Inter-FPGA Communication
    • Kobayashi Ryohei
    • Fujita Norihisa
    • Yamaguchi Yoshiki
    • Boku Taisuke
    • Yoshikawa Kohji
    • Abe Makito
    • Umemura Masayuki
    Ryohei Kobayashi, Norihisa Fujita, Yoshiki Yamaguchi, Taisuke Boku, Kohji Yoshikawa, Makito Abe, and Masayuki Umemura. 2023. GPU–FPGA-accelerated Radiative Transfer Simulation with Inter-FPGA Communication. In Proceedings of the International Conference on High Performance Computing in Asia-Pacific Region (HPCAsia '23). Association for Computing Machinery, New York, NY, USA, 117–125. https://doi.org/10.1145/3578178.3578231
  • Cygnus - World First Multihybrid Accelerated Cluster with GPU and FPGA Coupling
    • Boku Taisuke
    • Fujita Norihisa
    • Kobayashi Ryohei
    • Tatebe Osamu
    Taisuke Boku, Norihisa Fujita, Ryohei Kobayashi, and Osamu Tatebe. 2023. Cygnus - World First Multihybrid Accelerated Cluster with GPU and FPGA Coupling. In Workshop Proceedings of the 51st International Conference on Parallel Processing (ICPP Workshops '22). Association for Computing Machinery, New York, NY, USA, Article 8, 1–8. https://doi.org/10.1145/3547276.3548629
  • An Open-source FPGA Library for Data Sorting
    • Kobayashi Ryohei
    • Miura Kento
    • Fujita Norihisa
    • Boku Taisuke
    • Amagasa Toshiyuki
    Ryohei Kobayashi, Kento Miura, Norihisa Fujita, Taisuke Boku, Toshiyuki Amagasa, An Open-source FPGA Library for Data Sorting, Journal of Information Processing, 2022, Vol. 30, p. 766-777, published 2022/10/15, Online ISSN 1882-6652, https://doi.org/10.2197/ipsjjip.30.766, https://www.jstage.jst.go.jp/article/ipsjjip/30/0/30_766/_article/-char/ja, Abstract: