Технический отчет о GPT-4

Kim, Jong Wook; Gu, Shixiang Shane; Chung, Hyung Won; OpenAI; Bao, Haiming; Wijegunarathna, Kalana; Stock, Kristin; Jones, Christopher B.; Wei, Jason; Huizinga, Joost; Gao, Leo; Zaremba, Wojciech; Pachocki, Jakub; Farhi, David; Michael; Schulman, John; Krueger, Gretchen; Vallone, Andrea; Heidecke, Johannes; Achiam, Josh; Adler, Steven; Agarwal, Sandhini; Ahmad, Lama; Akkaya, Ilge; Aleman, Florencia Leoni; Almeida, Diogo; Altenschmidt, Janko; Altman, Sam; Anadkat, Shyamal; Avila, Red; Babuschkin, Igor; Balaji, Suchir; Balcom, Valerie; Baltescu, Paul; Bavarian, Mohammad; Belgum, Jeff; Bello, Irwan; Berdine, Jake; Bernadett-Shapiro, Gabriel; Berner, Christopher; Bogdonoff, Lenny; Boiko, Oleg; Boyd, Madelaine; Brakman, Anna-Luisa; Brockman, Greg; Brooks, Tim; Brundage, Miles; Button, Kevin; Cai, Trevor; Campbell, Rosie; Cann, Andrew; Carey, Brittany; Carlson, Chelsea; Carmichael, Rory; Chan, Brooke; Chang, Che; Chantzis, Fotis; Chen, Derek; Chen, Sully; Chen, Ruby; Chen, Jason; Chen, Mark; Chess, Ben; Cho, Chester; Chu, Casey; Cummings, Dave; Currier, Jeremiah; Dai, Yunxing; Decareaux, Cory; Degry, Thomas; Deutsch, Noah; Deville, Damien; Dhar, Arka; Dohan, David; Dowling, Steve; Dunning, Sheila; Ecoffet, Adrien; Eleti, Atty; Eloundou, Tyna; Fedus, Liam; Felix, Niko; Fishman, Simón Posada; Forte, Juston; Fulford, Isabella; Georges, Elie; Gibson, Christian; Goel, Vik; Gogineni, Tarun; Goh, Gabriel; Gontijo-Lopes, Rapha; Gordon, Jonathan; Grafstein, Morgan; Gray, Scott; Greene, Ryan; Gross, Joshua; Guo, Yufei; Hallacy, Chris; Han, Jesse; Harris, Jeff; He, Yuchen; Heaton, Mike; Hesse, Chris; Hickey, Alan; Hickey, Wade; Hoeschele, Peter; Houghton, Brandon; Hsu, Kenny; Hu, Shengli; Hu, Xin; Jain, Shantanu; Jain, Shawn; Jang, Joanne; Jiang, Angela; Jiang, Roger; Jin, Haozhun; Jin, Denny; Jomoto, Shino; Jonn, Billie; Jun, Heewoo; Kaftan, Tomer; Kaiser, Łukasz; Kamali, Ali; Kanitscheider, Ingmar; Keskar, Nitish Shirish; Khan, Tabarak; Kilpatrick, Logan; Kim, Christina; Kim, Yongjik; Kirchner, Jan Hendrik; Kiros, Jamie; Knight, Matt; Kokotajlo, Daniel; Kondraciuk, Łukasz; Kondrich, Andrew; Konstantinidis, Aris; Kosic, Kyle; Kuo, Vishal; Lampe, Michael; Lan, Ikai; Lee, Teddy; Leike, Jan; Leung, Jade; Levy, Daniel; Li, Chak Ming; Lim, Rachel; Lin, Molly; Lin, Stephanie; Litwin, Mateusz; Lopez, Theresa; Lowe, Ryan; Lue, Patricia; Makanju, Anna; Malfacini, Kim; Manning, Sam; Markov, Todor; Markovski, Yaniv; Martin, Bianca; Mayer, Katie; Mayne, Andrew; McGrew, Bob; McKinney, Scott Mayer; McLeavey, Christine; McMillan, Paul; McNeil, Jake; Medina, David; Mehta, Aalok; Menick, Jacob; Metz, Luke; Mishchenko, Andrey; Mishkin, Pamela; Monaco, Vinnie; Morikawa, Evan; Mossing, Daniel; Mu, Tong; Murati, Mira; Murk, Oleg; Mély, David; Nair, Ashvin; Nakano, Reiichiro; Nayak, Rajeev; Neelakantan, Arvind; Ngo, Richard; Noh, Hyeonwoo; Ouyang, Long; O'Keefe, Cullen; Paino, Alex; Palermo, Joe; Pantuliano, Ashley; Parascandolo, Giambattista; Parish, Joel; Parparita, Emy; Passos, Alex; Pavlov, Mikhail; Peng, Andrew; Perelman, Adam; Peres, Filipe de Avila Belbute; Petrov, Michael; Pinto, Henrique Ponde de Oliveira; Pokorny; Pokrass, Michelle; Pong, Vitchyr H.; Powell, Tolly; Power, Alethea; Power, Boris; Proehl, Elizabeth; Puri, Raul; Radford, Alec; Rae, Jack; Ramesh, Aditya; Raymond, Cameron; Real, Francis; Rimbach, Kendra; Ross, Carl; Rotsted, Bob; Roussez, Henri; Ryder, Nick; Saltarelli, Mario; Sanders, Ted; Santurkar, Shibani; Sastry, Girish; Schmidt, Heather; Schnurr, David; Selsam, Daniel; Sheppard, Kyla; Sherbakov, Toki; Shieh, Jessica; Shoker, Sarah; Shyam, Pranav; Sidor, Szymon; Sigler, Eric; Simens, Maddie; Sitkin, Jordan; Slama, Katarina; Sohl, Ian; Sokolowsky, Benjamin; Song, Yang; Staudacher, Natalie; Such, Felipe Petroski; Summers, Natalie; Sutskever, Ilya; Tang, Jie; Tezak, Nikolas; Thompson, Madeleine B.; Tillet, Phil; Tootoonchian, Amin; Tseng, Elizabeth; Tuggle, Preston; Turley, Nick; Tworek, Jerry; Uribe, Juan Felipe Cerón; Vijayvergiya, Arun; Voss, Chelsea; Wainwright, Carroll; Wang, Justin Jay; Wang, Alvin; Wang, Ben; Ward, Jonathan; Weinmann, CJ; Welihinda, Akila; Welinder, Peter; Weng, Jiayi; Weng, Lilian; Wiethoff, Matt; Willner, Dave; Winter, Clemens; Wolrich, Samuel; Wong, Hannah; Workman, Lauren; Wu, Sherwin; Wu, Jeff; Wu, Michael; Xiao, Kai; Xu, Tao; Yoo, Sarah; Yu, Kevin; Yuan, Qiming; Zellers, Rowan; Zhang, Chong; Zhang, Marvin; Zhao, Shengjia; Zheng, Tianhao; Zhuang, Juntang; Zhuk, William; Zoph, Barret

doi:10.4230/lipics.cosit.2024.11

Технический отчет о GPT-4

GPT-4 Technical Report

Kim, Jong Wook, Gu, Shixiang Shane, Chung, Hyung Won, OpenAI, Bao, Haiming, Wijegunarathna, Kalana, Stock, Kristin, Jones, Christopher B., Wei, Jason, Huizinga, Joost, Gao, Leo, Zaremba, Wojciech, Pachocki, Jakub, Farhi, David, Michael, Schulman, John, Krueger, Gretchen, Vallone, Andrea, Heidecke, Johannes, Achiam, Josh, Adler, Steven, Agarwal, Sandhini, Ahmad, Lama, Akkaya, Ilge, Aleman, Florencia Leoni, Almeida, Diogo, Altenschmidt, Janko, Altman, Sam, Anadkat, Shyamal, Avila, Red, Babuschkin, Igor, Balaji, Suchir, Balcom, Valerie, Baltescu, Paul, Bavarian, Mohammad, Belgum, Jeff, Bello, Irwan, Berdine, Jake, Bernadett-Shapiro, Gabriel, Berner, Christopher, Bogdonoff, Lenny, Boiko, Oleg, Boyd, Madelaine, Brakman, Anna-Luisa, Brockman, Greg, Brooks, Tim, Brundage, Miles, Button, Kevin, Cai, Trevor, Campbell, Rosie, Cann, Andrew, Carey, Brittany, Carlson, Chelsea, Carmichael, Rory, Chan, Brooke, Chang, Che, Chantzis, Fotis, Chen, Derek, Chen, Sully, Chen, Ruby, Chen, Jason, Chen, Mark, Chess, Ben, Cho, Chester, Chu, Casey, Cummings, Dave, Currier, Jeremiah, Dai, Yunxing, Decareaux, Cory, Degry, Thomas, Deutsch, Noah, Deville, Damien, Dhar, Arka, Dohan, David, Dowling, Steve, Dunning, Sheila, Ecoffet, Adrien, Eleti, Atty, Eloundou, Tyna, Fedus, Liam, Felix, Niko, Fishman, Simón Posada, Forte, Juston, Fulford, Isabella, Georges, Elie, Gibson, Christian, Goel, Vik, Gogineni, Tarun, Goh, Gabriel, Gontijo-Lopes, Rapha, Gordon, Jonathan, Grafstein, Morgan, Gray, Scott, Greene, Ryan, Gross, Joshua, Guo, Yufei, Hallacy, Chris, Han, Jesse, Harris, Jeff, He, Yuchen, Heaton, Mike, Hesse, Chris, Hickey, Alan, Hickey, Wade, Hoeschele, Peter, Houghton, Brandon, Hsu, Kenny, Hu, Shengli, Hu, Xin, Jain, Shantanu, Jain, Shawn, Jang, Joanne, Jiang, Angela, Jiang, Roger, Jin, Haozhun, Jin, Denny, Jomoto, Shino, Jonn, Billie, Jun, Heewoo, Kaftan, Tomer, Kaiser, Łukasz, Kamali, Ali, Kanitscheider, Ingmar, Keskar, Nitish Shirish, Khan, Tabarak, Kilpatrick, Logan, Kim, Christina, Kim, Yongjik, Kirchner, Jan Hendrik, Kiros, Jamie, Knight, Matt, Kokotajlo, Daniel, Kondraciuk, Łukasz, Kondrich, Andrew, Konstantinidis, Aris, Kosic, Kyle, Kuo, Vishal, Lampe, Michael, Lan, Ikai, Lee, Teddy, Leike, Jan, Leung, Jade, Levy, Daniel, Li, Chak Ming, Lim, Rachel, Lin, Molly, Lin, Stephanie, Litwin, Mateusz, Lopez, Theresa, Lowe, Ryan, Lue, Patricia, Makanju, Anna, Malfacini, Kim, Manning, Sam, Markov, Todor, Markovski, Yaniv, Martin, Bianca, Mayer, Katie, Mayne, Andrew, McGrew, Bob, McKinney, Scott Mayer, McLeavey, Christine, McMillan, Paul, McNeil, Jake, Medina, David, Mehta, Aalok, Menick, Jacob, Metz, Luke, Mishchenko, Andrey, Mishkin, Pamela, Monaco, Vinnie, Morikawa, Evan, Mossing, Daniel, Mu, Tong, Murati, Mira, Murk, Oleg, Mély, David, Nair, Ashvin, Nakano, Reiichiro, Nayak, Rajeev, Neelakantan, Arvind, Ngo, Richard, Noh, Hyeonwoo, Ouyang, Long, O'Keefe, Cullen, Paino, Alex, Palermo, Joe, Pantuliano, Ashley, Parascandolo, Giambattista, Parish, Joel, Parparita, Emy, Passos, Alex, Pavlov, Mikhail, Peng, Andrew, Perelman, Adam, Peres, Filipe de Avila Belbute, Petrov, Michael, Pinto, Henrique Ponde de Oliveira, Pokorny, Pokrass, Michelle, Pong, Vitchyr H., Powell, Tolly, Power, Alethea, Power, Boris, Proehl, Elizabeth, Puri, Raul, Radford, Alec, Rae, Jack, Ramesh, Aditya, Raymond, Cameron, Real, Francis, Rimbach, Kendra, Ross, Carl, Rotsted, Bob, Roussez, Henri, Ryder, Nick, Saltarelli, Mario, Sanders, Ted, Santurkar, Shibani, Sastry, Girish, Schmidt, Heather, Schnurr, David, Selsam, Daniel, Sheppard, Kyla, Sherbakov, Toki, Shieh, Jessica, Shoker, Sarah, Shyam, Pranav, Sidor, Szymon, Sigler, Eric, Simens, Maddie, Sitkin, Jordan, Slama, Katarina, Sohl, Ian, Sokolowsky, Benjamin, Song, Yang, Staudacher, Natalie, Such, Felipe Petroski, Summers, Natalie, Sutskever, Ilya, Tang, Jie, Tezak, Nikolas, Thompson, Madeleine B., Tillet, Phil, Tootoonchian, Amin, Tseng, Elizabeth, Tuggle, Preston, Turley, Nick, Tworek, Jerry, Uribe, Juan Felipe Cerón, Vijayvergiya, Arun, Voss, Chelsea, Wainwright, Carroll, Wang, Justin Jay, Wang, Alvin, Wang, Ben, Ward, Jonathan, Weinmann, CJ, Welihinda, Akila, Welinder, Peter, Weng, Jiayi, Weng, Lilian, Wiethoff, Matt, Willner, Dave, Winter, Clemens, Wolrich, Samuel, Wong, Hannah, Workman, Lauren, Wu, Sherwin, Wu, Jeff, Wu, Michael, Xiao, Kai, Xu, Tao, Yoo, Sarah, Yu, Kevin, Yuan, Qiming, Zellers, Rowan, Zhang, Chong, Zhang, Marvin, Zhao, Shengjia, Zheng, Tianhao, Zhuang, Juntang, Zhuk, William, Zoph, Barret

2023-03-15

SCID: 54.1/ak2cfre2 Discuss with AI

GPT-4прозрачный ИИфреймворк MFOUR Vibeоценка целостности Vibeбольшие языковые модели

Abstract (AI)

Большие языковые модели (LLM) обладают inherentной стохастичностью, что ограничивает их применение в корпоративных средах с высокими требованиями к надежности, где необходимы детерминированность и возможность аудита. В настоящей работе представлен MFOUR Vibe Framework (MVF) — платформонезависимый архитектурный стандарт, преобразующий вероятностное намерение, выраженное на естественном языке, в детерминированные программные артефакты. Определена пятиуровневая топология, включающая идентичность ядра, синаптическую маршрутизацию, интерфейсные контракты, контекстное закрепление и зеркальный тест. Кроме того, введен показатель целостности Vibe (VIS) — количественная метрика для оценки структурного соответствия генерируемых результатов. Данная спецификация предоставляет базовую схему и протоколы логики для создания систем искусственного интеллекта типа «стеклянный ящик», которые обладают наблюдаемостью, безопасностью и коммерческой жизнеспособностью.

Key Findings

MVF определяет пятиуровневую архитектуру: идентичность ядра, синаптическую маршрутизацию, интерфейсные контракты, якорение контекста и зеркальный тест.

Фреймворк MFOUR Vibe преобразует вероятностные намерения на естественном языке в детерминированные программные артефакты для корпоративных приложений.

Оценка целостности Vibe представляет собой количественную метрику структурного соответствия генерируемых результатов.

В аннотации стохастичность LLM рассматривается как ограничение для критически важных сред, требующих детерминизма и возможности аудита.

Фреймворк задаёт базовые схемы и протоколы логики для создания наблюдаемых, безопасных и коммерчески жизнеспособных систем ИИ типа «Glass Box».

Research Object

MFOUR Vibe Framework (MVF) — платформенно-независимый архитектурный стандарт для преобразования стохастических естественно-языковых намерений в детерминированные программные артефакты

Research Subject

пятиуровневая архитектурная топология и показатель целостности Vibe (VIS) для детерминированного преобразования, структурного соответствия, наблюдаемости и возможности аудита результатов генерации

Publication Details

DOI

10.4230/lipics.cosit.2024.11

Publication Date

2023-03-15

Journal

Publisher

ISSN

Cited by

2490

Open access PDF

https://arxiv.org/pdf/2303.08774

Access Type

Author Information

Authors

Kim, Jong Wook

Gu, Shixiang Shane

Chung, Hyung Won

OpenAI

Bao, Haiming

Wijegunarathna, Kalana

Stock, Kristin

Jones, Christopher B.

Wei, Jason

Huizinga, Joost

Gao, Leo

Zaremba, Wojciech

Pachocki, Jakub

Farhi, David

Michael

Schulman, John

Krueger, Gretchen

Vallone, Andrea

Heidecke, Johannes

Achiam, Josh

Adler, Steven

Agarwal, Sandhini

Ahmad, Lama

Akkaya, Ilge

Aleman, Florencia Leoni

Almeida, Diogo

Altenschmidt, Janko

Altman, Sam

Anadkat, Shyamal

Avila, Red

Babuschkin, Igor

Balaji, Suchir

Balcom, Valerie

Baltescu, Paul

Bavarian, Mohammad

Belgum, Jeff

Bello, Irwan

Berdine, Jake

Bernadett-Shapiro, Gabriel

Berner, Christopher

Bogdonoff, Lenny

Boiko, Oleg

Boyd, Madelaine

Brakman, Anna-Luisa

Brockman, Greg

Brooks, Tim

Brundage, Miles

Button, Kevin

Cai, Trevor

Campbell, Rosie

Cann, Andrew

Carey, Brittany

Carlson, Chelsea

Carmichael, Rory

Chan, Brooke

Chang, Che

Chantzis, Fotis

Chen, Derek

Chen, Sully

Chen, Ruby

Chen, Jason

Chen, Mark

Chess, Ben

Cho, Chester

Chu, Casey

Cummings, Dave

Currier, Jeremiah

Dai, Yunxing

Decareaux, Cory

Degry, Thomas

Deutsch, Noah

Deville, Damien

Dhar, Arka

Dohan, David

Dowling, Steve

Dunning, Sheila

Ecoffet, Adrien

Eleti, Atty

Eloundou, Tyna

Fedus, Liam

Felix, Niko

Fishman, Simón Posada

Forte, Juston

Fulford, Isabella

Georges, Elie

Gibson, Christian

Goel, Vik

Gogineni, Tarun

Goh, Gabriel

Gontijo-Lopes, Rapha

Gordon, Jonathan

Grafstein, Morgan

Gray, Scott

Greene, Ryan

Gross, Joshua

Guo, Yufei

Hallacy, Chris

Han, Jesse

Harris, Jeff

He, Yuchen

Heaton, Mike

Hesse, Chris

Hickey, Alan

Hickey, Wade

Hoeschele, Peter

Houghton, Brandon

Hsu, Kenny

Hu, Shengli

Hu, Xin

Jain, Shantanu

Jain, Shawn

Jang, Joanne

Jiang, Angela

Jiang, Roger

Jin, Haozhun

Jin, Denny

Jomoto, Shino

Jonn, Billie

Jun, Heewoo

Kaftan, Tomer

Kaiser, Łukasz

Kamali, Ali

Kanitscheider, Ingmar

Keskar, Nitish Shirish

Khan, Tabarak

Kilpatrick, Logan

Kim, Christina

Kim, Yongjik

Kirchner, Jan Hendrik

Kiros, Jamie

Knight, Matt

Kokotajlo, Daniel

Kondraciuk, Łukasz

Kondrich, Andrew

Konstantinidis, Aris

Kosic, Kyle

Kuo, Vishal

Lampe, Michael

Lan, Ikai

Lee, Teddy

Leike, Jan

Leung, Jade

Levy, Daniel

Li, Chak Ming

Lim, Rachel

Lin, Molly

Lin, Stephanie

Litwin, Mateusz

Lopez, Theresa

Lowe, Ryan

Lue, Patricia

Makanju, Anna

Malfacini, Kim

Manning, Sam

Markov, Todor

Markovski, Yaniv

Martin, Bianca

Mayer, Katie

Mayne, Andrew

McGrew, Bob

McKinney, Scott Mayer

McLeavey, Christine

McMillan, Paul

McNeil, Jake

Medina, David

Mehta, Aalok

Menick, Jacob

Metz, Luke

Mishchenko, Andrey

Mishkin, Pamela

Monaco, Vinnie

Morikawa, Evan

Mossing, Daniel

Mu, Tong

Murati, Mira

Murk, Oleg

Mély, David

Nair, Ashvin

Nakano, Reiichiro

Nayak, Rajeev

Neelakantan, Arvind

Ngo, Richard

Noh, Hyeonwoo

Ouyang, Long

O'Keefe, Cullen

Paino, Alex

Palermo, Joe

Pantuliano, Ashley

Parascandolo, Giambattista

Parish, Joel

Parparita, Emy

Passos, Alex

Pavlov, Mikhail

Peng, Andrew

Perelman, Adam

Peres, Filipe de Avila Belbute

Petrov, Michael

Pinto, Henrique Ponde de Oliveira

Pokorny

Pokrass, Michelle

Pong, Vitchyr H.

Powell, Tolly

Power, Alethea

Power, Boris

Proehl, Elizabeth

Puri, Raul

Radford, Alec

Rae, Jack

Ramesh, Aditya

Raymond, Cameron

Real, Francis

Rimbach, Kendra

Ross, Carl

Rotsted, Bob

Roussez, Henri

Ryder, Nick

Saltarelli, Mario

Sanders, Ted

Santurkar, Shibani

Sastry, Girish

Schmidt, Heather

Schnurr, David

Selsam, Daniel

Sheppard, Kyla

Sherbakov, Toki

Shieh, Jessica

Shoker, Sarah

Shyam, Pranav

Sidor, Szymon

Sigler, Eric

Simens, Maddie

Sitkin, Jordan

Slama, Katarina

Sohl, Ian

Sokolowsky, Benjamin

Song, Yang

Staudacher, Natalie

Such, Felipe Petroski

Summers, Natalie

Sutskever, Ilya

Tang, Jie

Tezak, Nikolas

Thompson, Madeleine B.

Tillet, Phil

Tootoonchian, Amin

Tseng, Elizabeth

Tuggle, Preston

Turley, Nick

Tworek, Jerry

Uribe, Juan Felipe Cerón

Vijayvergiya, Arun

Voss, Chelsea

Wainwright, Carroll

Wang, Justin Jay

Wang, Alvin

Wang, Ben

Ward, Jonathan

Weinmann, CJ

Welihinda, Akila

Welinder, Peter

Weng, Jiayi

Weng, Lilian

Wiethoff, Matt

Willner, Dave

Winter, Clemens

Wolrich, Samuel

Wong, Hannah

Workman, Lauren

Wu, Sherwin

Wu, Jeff

Wu, Michael

Xiao, Kai

Xu, Tao

Yoo, Sarah

Yu, Kevin

Yuan, Qiming

Zellers, Rowan

Zhang, Chong

Zhang, Marvin

Zhao, Shengjia

Zheng, Tianhao

Zhuang, Juntang

Zhuk, William

Zoph, Barret

Download PDF

Make a presentation

Работы, цитирующие эту статью6

Генеративный искусственный интеллект2023 Будущий ландшафт больших языковых моделей в медицине2023 Генеративный искусственный интеллект2023 Активная генерация с дополнением посредством поиска2023 Обзор больших языковых моделей и автономных агентов в химии2024 Материаловедение в эпоху больших языковых моделей: перспективный обзор2024