- May 7 - 11, 2024
- Vienna, Austria
ICLR 2024
The Twelfth International Conference on Learning Representation
We look forward to this year's exciting sponsorship and exhibition opportunities, featuring a variety of ways to connect with participants in person. Sony will exhibit and participate as a Bronze sponsor.
Workshop
Data Problems for Foundation Models
Foundation Models (FMs, e.g., GPT-3/4, LLaMA, DALL-E, Stable Diffusion, etc.) have demonstrated unprecedented
performance across a wide range of downstream tasks. Following the rapid evolution, as researchers strive to keep up
with the understanding of the capabilities and limitations of FMs as well as their implications, attention is now
shifting to the emerging notion of data-centric AI.
Curation of training data is crucially important for the performance and reliability of FMs and a wealth of recent works
demonstrate that data-perspective research sheds light on a promising direction toward critical issues such as safety,
alignment, efficiency, security, privacy, interpretability, etc.
To move forward, this workshop aims to discuss and explore a better understanding of the new paradigm for research on
data problems for foundation models.
We look forward to meeting communities and researchers on data problems (e.g., data-centric AI, dataset/data curation,
data market), foundation models (alignment, safety/trustworthiness, fairness/ethics), practitioners of downstream
applications, tech companies providing innovative solutions, and beyond! We strive to build a community behind this
essential topic and provide the platform to connect, share ideas, explore for consensus, and create collaboration
opportunities.
- Title:
- Data Problems for Foundation Models
- Website:
- https://sites.google.com/view/dpfm-iclr24/home
- Date:
- May 11, 2024
- Sony AI Participants:
- Jerone Andrews (Organizer)
- Location:
- Vienna, Austria + Zoom
- Room:
- Messe Wien Exhibition Congress Center
Publications
Publication 01 Consistency Trajectory Models: Learning Probability Flow ODE Trajectory of Diffusion
- Authors:
- Dongjun Kim (Sony AI), Chieh-Hsin Lai (Sony AI), Wei-Hsiang Liao (Sony AI), Naoki Murata (Sony AI), Yuhta Takida (Sony AI), Toshimitsu Uesaka (Sony AI), Yutong He (Sony AI), Yuki Mitsufuji (Sony AI), Stefano Ermon
- Link:
- https://arxiv.org/abs/2310.02279
Publication 02 Manifold Preserving Guided Diffusion
- Authors:
- Yutong He (Sony AI), Naoki Murata (Sony AI), Chieh-Hsin Lai (Sony AI), Yuhta Takida (Sony AI), Toshimitsu Uesaka (Sony AI), Dongjun Kim (Sony AI), Wei-Hsiang Liao (Sony AI), Yuki Mitsufuji (Sony AI), J. Zico Kolter, Ruslan Salakhutdinov, Stefano Ermon
- Link:
- https://arxiv.org/abs/2311.16424
Publication 03 SAN: Inducing Metrizability of GAN with Discriminative Normalized Linear Layer
- Authors:
- Yuhta Takida (Sony AI), Masaaki Imaizumi, Takashi Shibuya (Sony AI), Chieh-Hsin Lai (Sony AI), Toshimitsu Uesaka (Sony AI), Naoki Murata (Sony AI), Yuki Mitsufuji (Sony AI)
- Link:
- https://arxiv.org/abs/2301.12811
Publication 04 Towards Principled Representation Learning from Videos for Reinforcement Learning
- Authors:
- Dipendra Misra, Akanksha Saran (Sony AI), Tengyang Xie, Alex Lamb, John Langford
- Link:
- https://openreview.net/forum?id=3mnWvUZIXt&referrer=%5BAuthor%20Console%5D(%2Fgroup%3Fid%3DICLR.cc%2F2024%2FConference%2FAuthors%23your-submissions)
Publication 05 FedP3: Federated Personalized and Privacy-friendly Network Pruning under Model Heterogeneity
- Authors:
- Kai Yi (Sony AI), Nidham Gazagnadou (Sony AI), Peter Richtárik, Lingjuan Lyu (Sony AI)
- Link:
- https://openreview.net/forum?id=hbHwZYqk9T
Publication 06 Detecting, Explaining, and Mitigating Memorization in Diffusion Models
- Authors:
- Yuxin Wen (Sony AI), Yuchen Liu (Sony AI), Chen Chen (Sony AI), Lingjuan Lyu (Sony AI)
- Link:
- https://openreview.net/forum?id=84n3UwkH7b
Publication 07 FedWon: Triumphing Multi-domain Federated Learning Without Normalization
Publication 08 Views Can Be Deceiving: Improved SSL Through Feature Space Augmentation
- Authors:
- Kimia Hamidieh, Haoran Zhang, Swami Sankaranarayanan (Sony AI), Marzyeh Ghassemi
- Link:
- https://openreview.net/forum?id=mutJBk3ILg
Publication 09 DIAGNOSIS: Detecting Unauthorized Data Usages in Text-to-image Diffusion Models
- Authors:
- Zhenting Wang (Sony AI), Chen Chen (Sony AI), Lingjuan Lyu (Sony AI), Dimitris N. Metaxas, Shiqing Ma
- Link:
- https://openreview.net/forum?id=f8S3aLm0Vp
Publication 10 Understanding multimodal contrastive learning through pointwise mutual information
Recruiting Information
Recruiting Information
We look forward to working with highly motivated individuals to fill the world with emotion and to pioneer future
innovation through dreams and curiosity. With us, you will be welcomed onto diverse, innovative, and creative teams set
out to inspire the world.
At this time, the full-time and internship roles previously listed on this page are closed.
Please see all other open positions through the links below.
Sony AI: https://ai.sony/joinus/jobroles/
Global Careers Page: https://www.sony.com/en/SonyInfo/Careers/japan/
NOTE: For those interested in Japan-based full-time and internship opportunities, please note the following points and benefits
- Japanese language skills are NOT required, as your work will be conducted in English.
- Regarding Japan-based internships, please note that they are paid, and that we additionally cover round trip flights, visa expenses, commuting expenses, and accommodation expenses as part of our support package.
- Regarding Japan-based full-time roles, in addition to your compensation and benefits package, we cover your flight to Japan, shipment of your belongings to Japan, visa expenses, commuting expenses, and more!
