Add intgemm tests for avx, avx2, avx512

33 files changed, 1525 insertions, 0 deletions

diff --git a/tests/decoder/intgemm/.gitignore b/tests/decoder/intgemm/.gitignore
new file mode 100644
index 0000000..3ab86da
--- /dev/null
+++ b/tests/decoder/intgemm/.gitignore
@@ -0,0 +1,4 @@
+*.bin
+*.out.bleu
+*.src
+*.ref
diff --git a/tests/decoder/intgemm/README.md b/tests/decoder/intgemm/README.md
new file mode 100644
index 0000000..9c8e9ca
--- /dev/null
+++ b/tests/decoder/intgemm/README.md
@@ -0,0 +1,2 @@
+Regression test outputs have been generated on valhalla using gna (avx), hodor
+(avx2), and fulla (avx512). No outputs generated for avx512_vnni yet.
diff --git a/tests/decoder/intgemm/collect.sh b/tests/decoder/intgemm/collect.sh
new file mode 100644
index 0000000..346965d
--- /dev/null
+++ b/tests/decoder/intgemm/collect.sh
@@ -0,0 +1,4 @@
+for f in `ls *.out`; do 
+    cp $f $(basename $f .out).avx.expected
+    cp $f.bleu $(basename $f .out).avx.expected.bleu
+done
diff --git a/tests/decoder/intgemm/fbgemm_intgemm_8bit.avx2.expected b/tests/decoder/intgemm/fbgemm_intgemm_8bit.avx2.expected
new file mode 100644
index 0000000..4772f0a
--- /dev/null
+++ b/tests/decoder/intgemm/fbgemm_intgemm_8bit.avx2.expected
@@ -0,0 +1,100 @@
+Four members of Kemerovo gang detained in Estonia and Spain
+Slava Gulevich, the leader of the so-called Kemerovo group in the Estonian underworld and is known in the criminal world as Slava Kemerovsky, was detained by police in Spain, according to the Post.
+Gulevich, who was detained in Spain, was arrested with court permission.
+Yesterday, the court also took custody of three suspects detained in Estonia.
+The suspects are members of the so-called Kemerovo Crime Society between the ages of 27 and 57, who mainly commit drug offences.
+The alleged leader of a criminal association has been detained in Mija, Malaga province, Spain.
+Three men were arrested on suspicion in Estonia, one of whom is a leading figure in the criminal association, according to the data collected, and two are members of the criminal association.
+The data collected indicate that the tasks and roles were clearly distributed in the criminal community.
+The purpose of the criminal association's activities was to commit drug offences and thus generate criminal proceeds," said Mr Verte, the head of pretrial proceedings in the criminal case and state prosecutor.
+"We do not rule out an increase in the number of suspects in this criminal case," the prosecutor added.
+These are people who have been in the interest of law enforcement in the past, and some have served sentences for drug offences.
+Verte stressed that cooperation with its Spanish counterparts has been important throughout the investigation.
+"International cooperation has become commonplace for us, and this week's operation shows the success of cooperation," prosecutor Verte said.
+Ago Leis, head of the Central Criminal Police Service, said the arrests were preceded by a probe into nearly a year and a half.
+"In the first half of the year, the long-term work materialised and we detained suspects of crimes in Estonia and Spain at the same time," he said.
+Leis added that Central Criminal Police officers were assisting in their detention in Spain.
+For years we have had good contact and understanding with the Spanish police and civilian Guard.
+These arrests are yet another message to criminals that we can get them from the other end of Europe," Leis said.
+The information gathered so far clearly indicates that the men on suspicion of committing new crimes while in prison may continue to commit new crimes, which is why the prosecution has requested their arrest and the court approved it.
+A man arrested in Spain is awaiting transfer to Estonia.
+Property, vehicles and cash have been seized in this criminal case to ensure confiscation.
+The pre-trial proceedings in the case are carried out by the Central Criminal Police Organised Crime Bureau and led by the Crown Prosecution Service.
+Slava Gulevich was convicted by a district court in 2005 of racketeering and sentenced to five years in prison.
+In the middle of the last decade, Gulevich was considered the second most important man in the Estonian criminal world after Nikolai Tarankov, then underworld leader.
+Gulevich, from Kemerovo, rose to prominence in the Estonian underworld in the early 1990s when he began extortion in Tallinn.
+He allegedly taxi drivers and prostitutes operating at various hotels and demanded monthly rookie taxes from businessmen.
+International joint operations, confiscations of criminal proceeds and court rulings that have entered into force confirm that the fight in the area of organised crime is effective.
+For example, the latest court rulings, eight defendants separated from the so-called Dikayev Criminal Association criminal case, who were ordered to pay BGN 80,000, or the judgment of nine individuals in 2006 forged a criminal association aimed at the illegal trade in cigarettes and the committing of crimes related to human trafficking in East Virginia and South Estonia in 2006.
+Confidential criminal proceeds there are around EUR 71,500.
+In these criminal matters, the success of police officers have ensured that police officers exchange information and evidence with foreign colleagues every day and, if necessary, carry out actions together in any European Union country.
+Civil rights group warns against travel to Missouri
+The National Association for the Advancement of Colored People (NAACP) has warned black people traveling to Missouri against discriminatory policies and racist attacks in the state.
+The group's statement reads: "The NAACP travel note issued for the state of Mussour, which runs until August 28, 2017, invites all African-American travelers, visitors and Missourians to be particularly attentive and extremely careful as they move around the state, taking into account the suspicious racial events that have recently taken place across the state and are listed here."
+The NAACP said the group was encouraged to issue travel warnings both by a recent Missouri law making it harder to win discrimination lawsuits and the fact that the state's law enforcement agencies target, in large part, minorities.
+"People's civil rights are being violated.
+They are pulled to the side of the road because of the colour of their skin, beaten or killed," Rod Chapel, president of the NAACP's Missouri branch, told The Kansas City Star.
+'We've never had such close complaints before.'
+It is the first such warning the organization has issued for the U.S. state.
+The group cited events such as racist insults at the University of Missouri and the death of Tory Sanders, a 28-year-old black man from Tennessee.
+Sanders died in suspicious circumstances earlier this year after he ran out of petrol while driving through the state and was taken into custody by Missouri police without being charged with a crime.
+In addition, the note refers to a recent report by the Missouri Attorney General, which shows that in the state, black drivers are 75% more likely to be stopped than white people.
+"It's meant to make people aware and warn their families, friends and co-workers about what could happen in Missouri," Chapel said.
+"People have to be ready, whether it means taking bail money or informing relatives that they are going through the state," he said.
+According to the latest data from the FBI's hate crime reporting program, Missouri documented 100 hate crimes in 2015, putting the state 16th in the state's number of similar violations.
+The travel warning is also a response to Missouri's new law, which makes it difficult for a company to sue for discrimination in search of a home or job.
+The American Civil Liberties Union (American Civil Liberties Union) had previously issued travel notices for Texas and Arizona after those states passed immigration laws requiring people with local authorities to arrest people for immigration violations because the ACLU said it would increase racial profiling.
+Typically, travel warnings are issued by the Department of Foreign Affairs for other countries, but interest groups have recently begun to use the measure as a counter-reaction to certain U.S. laws and trends.
+Hepatitis: what would anyone know about the different forms of this serious disease?
+Hepatitis, or liver inflammation, can be caused by five different, A, B, C, D and hepatitis viruses.
+All these viruses trigger acute inflammation of liver tissue.
+However, chronic hepatitis B and C is a chronic cost, which can develop into cirrhosis of the liver, or liver wrinkles and liver cancer.
+Listo Kutsar, an epidemiology adviser at the Health Department, says acute hepatitis is the same for all types of liver inflammation - fever, fatigue, appetite, nausea, vomiting, abdominal pain, thin excrement, dark urine, muscle and joint pain, and the yellowness of the skin and mucus.
+The popular name for liver inflammation also comes from the latest disease.
+In children, hepatitis can go without signs of disease.
+Different types of inflammation can only be identified based on data from laboratory studies.
+Extreme hepatitis can transition into chronic hepatitis and run for decades without signs of disease, meaning people may not know anything about their dangerous liver-damaging disease.
+Mr Kutsar points out different forms of hepatitis and describes their progress in more detail.
+Hepatitis A viruses spread from sick people and infect us by eating contaminated food or drinking water, by sex, from the stools of an infected person to their hands and from their hands to their arms, surfaces, objects, objects, mouths and taking drugs.
+Family members and caregivers of hepatitis infection, people with chronic liver disease, people who have sex with infected people, men who have sex with men, drug addicts, travelers visiting countries with hepatitis A high spread.
+Infectiousness can be prevented by vaccination, in particular vaccination for people travelling and at risk of hepatitis A.
+In addition, daily hygiene compliance is important: wash or disinfect your hands, washing all fruit and vegetables before using it for food.
+Hepatitis B viruses are spread when exposed to the blood of a sick person, injecting drugs, tattooing, hole-in-duty, using blood-contaminated creatures (toothbrushes, waste products), donor blood, having sex with a hepatitis-cheek person, and from a hepatitis-stricken mother to foetus/born.
+The risk group for hepatitis B infection includes injection drug users, sex partners of an infected person, men having sex with men, newborns of an infected mother, sick family members and caregivers, health care workers and police officers who are exposed to blood and other bodily fluids, and travelers visiting countries with high hepatitis B.
+People can be vaccinated to prevent hepatitis B; in particular, people at risk are recommended, as well as those with chronic liver disease, HIV infection, sexually transmitted diseases and diabetes.
+Other preventive measures for hepatitis B include: avoiding the use of foreign hygiene and manicure products, other sharpeners and needles, tattooing and holeing, and using condoms in cases of condom-threatention or avoiding sexual risky behaviour.
+Vaccinating hepatitis B is part of the national immunisation scheme in Estonia and free for children.
+Hepatitis C viruses are spread when exposed to a sick person's blood, injecting drugs, tattooing, skulls, using blood-contaminated creatures, donor blood, having sex with hepatitis Cathedral and hepatitis-stricken mother to foetus/bean birth.
+The risk group for hepatitis C infection includes injection drug users, sex partners of an infected person, men having sex with men, newborns of an infected mother, sick family members and carers, health, rescue workers and police officers exposed to blood and other bodily fluids, people with HIV infection, and travelers visiting countries with high hepatitis C.
+The prevention measure for hepatitis C is: avoiding the use of foreign hygiene and manicure products, other sharpeners and syringe ants, tattooing and sniffing, and using condoms in cases of contagious sex.
+There is no vaccine against hepatitis C.
+Hepatitis D is caused by a hepatitis D virus that reproduces in the presence of the hepatitis B virus.
+As a result, hepatitis D infection occurs in hepatitis B or as a super infection in chronic hepatitis B patients.
+Hepatitis D viruses are spread through contact with blood and other bodily fluids, with contaminated needles, sexually transmitted and rarely infected mother to the fetus.
+The risk group for hepatitis D is chronic hepatitis B virus carriers and people with no immunity against hepatitis B.
+An effective preventive measure is vaccination with the hepatitis B vaccine, which also protects people from hepatitis D infection.
+Hepatitis viruses spread through fetal-ord tea with drinking water and food, including eating low-heated beef, fish and sea cucumbers, donor blood, commonly used needles and infected mother to foetus.
+Passengers can become infected in countries with hepatitis E high rates.
+Hepatitis prevention measures include meeting hygiene requirements: wash or disinfect your hands after going to the toilet, before cooking and eating, after caring for the sick.
+Trees and vegetables to wash before consumption, avoid eating low-heated beef, fish and seafood, drink only safe drinking water and avoid drug use.
+While rivals tried to sprint the four-time Olympic champion off course in the final round, 34-year-old Farah found strength in the final round and won in 26.49.51.
+Farah didn't think long, pulling his wife Tania and children along the way with him after the finish.
+It was a special moment for me.
+I miss my family very much.
+Being on the track with them was wonderful," Farah told reporters.
+Farah is aiming for a fifth title race in London in a row with a golden duo of 5,000 and 10,000 metres.
+Anything is possible if you believe in it.
+Despite the title, Anne-Marie O'Connor's "Dam in Gold; Gustav Klimt's masterpiece, the extraordinary tale of Adele Bloch-Bauer's portrait," delves much deeper into the origin story of one art work in the late 19th and early 20th centuries Vienna's cultural life.
+But even more in history.
+The awesome amount of information might have been worn out, a thinner cut, a narrower subject that allowed the portrait allowed in the title to become more of an influence.
+There would be two books on the same cover: the story of Adele Bloch-Bauer, depicted in one cover, and the story of Adele Bloch-Bauer, depicted in her painting "Daam in gold," and a much larger and comprehensive historical record of esteemed Jewish families and the German occupation, along with its after-effects in Austria.
+The first third of the book leads to the cultural life of Vienna in the midst of a bustling Vienna, and who have themselves in the Austrian capital, one can imagine, without the slightest effort, how life went around Ringstrasse more than a hundred years ago, or how everyone turned their heads in the Central Cafe when Klimt stepped in.
+The concentration of cultural figures was high in one of Europe's richest cities, and when you see a familiar name in the book, you feel like a more grammar culture.
+At the same time, for example, the fact that Sigmund Freud operated in a city where incursive syphilis was rampant and was the highest suicide rate in Europe seems to add to the story's development.
+Or, perhaps, every pair of brushstrokes adds colours to the cultural life of the early 20th century in Vienna.
+The dream of a trip to the Soviet Union
+In the last decades of the 19th century, the number of Jews in Vienna had exploded, becoming the largest Jewish community in Western Europe.
+At the turn of the century, almost one in ten residents of Vienna was a Jew.
+Adele's parents were newcomers to Vienna, too, but by the time Adele married twice to open a Czech sugar magnate, Ferdinand Bloch, and Klimt was posing for his famous paintings, his father's bank had become the seventh largest bank in the Habsburg empire.
+But Adelet didn't draw all the glamorous life to which she belonged.
+If you look at "Dami's gold," it's hard to believe that towards the end of her life, this great lady became infected with socialism and dreamed of a trip to the Soviet Union.
diff --git a/tests/decoder/intgemm/fbgemm_intgemm_8bit.avx2.expected.bleu b/tests/decoder/intgemm/fbgemm_intgemm_8bit.avx2.expected.bleu
new file mode 100644
index 0000000..677cdce
--- /dev/null
+++ b/tests/decoder/intgemm/fbgemm_intgemm_8bit.avx2.expected.bleu
@@ -0,0 +1 @@
+BLEU+case.mixed+numrefs.1+smooth.exp+tok.13a+version.1.2.12 = 30.9 66.1/38.8/24.9/16.0 (BP = 0.971 ratio = 0.971 hyp_len = 2757 ref_len = 2838)
diff --git a/tests/decoder/intgemm/fbgemm_intgemm_8bit.avx512.expected b/tests/decoder/intgemm/fbgemm_intgemm_8bit.avx512.expected
new file mode 100644
index 0000000..c79f147
--- /dev/null
+++ b/tests/decoder/intgemm/fbgemm_intgemm_8bit.avx512.expected
@@ -0,0 +1,100 @@
+Four members of Kemerovo gang detained in Estonia and Spain
+Slava Gulevich, the leader of the so-called Kemerovo group in the Estonian underworld and is known in the criminal world as Slava Kemerovsky, was detained by police in Spain, according to the Post.
+Gulevich, who was detained in Spain, was arrested with court permission.
+Yesterday, the court also took custody of three suspects detained in Estonia.
+The suspects are members of the so-called Kemerovo Crime Society between the ages of 27 and 57, who mainly commit drug offences.
+The alleged leader of a criminal association has been detained in Mija, Malaga province, Spain.
+Three men were arrested on suspicion in Estonia, one of whom is a leading figure in the criminal association, according to the data collected, and two are members of the criminal association.
+The data collected indicate that the tasks and roles were clearly distributed in the criminal community.
+The purpose of the criminal association's activities was to commit drug offences and thus generate criminal proceeds," said Mr Verte, the head of pretrial proceedings in the criminal case.
+"We do not rule out an increase in the number of suspects in this criminal case," the prosecutor added.
+These are people who have been in the interest of law enforcement in the past, and some have served sentences for drug offences.
+Verte stressed that cooperation with its Spanish counterparts has been important throughout the investigation.
+"International cooperation has become commonplace for us, and this week's operation shows the success of the collaboration," prosecutor Verte said.
+Ago Leis, head of the Central Criminal Police Service, said the arrests were preceded by a probe into nearly a year and a half.
+"In the first half of the year, the long-term work materialised and we detained suspects of crimes in Estonia and Spain at the same time," he said.
+Leis added that Central Criminal Police officers were assisting in their detention in Spain.
+For years we have had good contact and understanding with the Spanish police and the Civil Guard.
+These arrests are yet another message to criminals that we can get them from the other end of Europe," Leis said.
+The information gathered so far clearly indicates that the men on suspicion of committing new crimes while in prison may continue to commit new crimes, which is why the prosecution has requested their arrest and the court approved it.
+A man arrested in Spain is awaiting transfer to Estonia.
+Property, vehicles and cash have been seized in this criminal case to ensure confiscation.
+The pre-trial proceedings in the case are carried out by the Central Criminal Police Organised Crime Bureau and led by the Crown Prosecution Service.
+Slava Gulevich was convicted by a district court in 2005 of racketeering and sentenced to five years in prison.
+In the middle of the last decade, Gulevich was considered the second most important man in the Estonian criminal world after Nikolai Tarankov, then underworld leader.
+Gulevich, from Kemerovo, rose to prominence in the Estonian underworld in the early 1990s when he began extortion in Tallinn.
+He allegedly taxi drivers and prostitutes operating at various hotels and demanded monthly rookie taxes from businessmen.
+International joint operations, confiscations of criminal proceeds and court rulings that have entered into force confirm that the fight in the area of organised crime is effective.
+For example, the latest court rulings, eight defendants separated from the so-called Dikayev Criminal Association criminal case, who were ordered to pay BGN 80,000 for the conviction of nine individuals, in 2006 forged a criminal association aimed at the illegal trade in cigarettes and the committing of crimes related to human trafficking in East Virginia and the South in Estonia.
+Confidential criminal proceeds there are around EUR 71,500.
+In these criminal matters, the success of police officers have ensured that police officers exchange information and evidence with foreign colleagues every day and, if necessary, carry out actions together in any European Union country.
+Civil rights group warns against travel to Missouri
+The National Association for the Advancement of Colored People (NAACP) has warned black people traveling to Missouri against discriminatory policies and racist attacks in the state.
+The group's statement reads: "The NAACP travel note issued for the state of Mussour, which runs until August 28, 2017, invites all African-Americans, visitors and Missourians to be particularly attentive and extremely careful as they move around the state, taking into account the entire suspicious racially-based events that have recently taken place across the state and are also listed here."
+The NAACP said the group urged the travel warning to issue both the recent Missouri law, which makes it harder to win discrimination lawsuits, and the fact that the state's law enforcement agencies target, in large part, largely by minorities.
+"People's civil rights are being violated.
+They are pulled to the side of the road because of the color of their skin, beaten or killed," Rod Chapel, president of the Missouri branch of the NAACP, told The Kansas City Star.
+'We've never had such close complaints before.'
+It is the first such warning the organization has issued for the U.S. state.
+The group cited events such as racist insults at the University of Missouri and the death of Tory Sanders, a 28-year-old black man from Tennessee.
+Sanders died in suspicious circumstances earlier this year after he ran out of petrol while driving through the state and was taken into custody by Missouri police without being charged with a crime.
+In addition, the note points to a recent report by the Missouri Attorney General, which shows that black drivers in the state are 75% more likely to be stopped than white people.
+"It's meant to make people aware and warn their families, friends and co-workers about what could happen in Missouri," Chapel said.
+"People have to be ready, whether it means taking bail money or informing relatives that they are going through the state," he said.
+According to the latest data from the FBI's hate crime reporting program, Missouri documented 100 hate crimes in 2015, putting the state 16th in the state's number of similar violations.
+The travel warning is also a response to Missouri's new law, which makes it difficult for a company to sue for discrimination in search of a home or job.
+The American Civil Liberties Union (American Civil Liberties Union) had previously issued travel notices for Texas and Arizona after those states passed immigration laws requiring people with local authorities to arrest people for immigration violations because the ACLU said it would increase racial profiling.
+Typically, travel warnings are issued by the Department of Foreign Affairs for other countries, but recently interest groups have started using the measure as a counter-reaction to certain U.S. laws and trends.
+Hepatitis: what would anyone know about the different forms of this serious disease?
+Hepatitis, or liver inflammation, can be caused by five different, A, B, C, D and hepatitis viruses.
+All these viruses trigger acute inflammation of liver tissue.
+However, chronic hepatitis B and C is a bad-coloured cost, which can develop into cirrhosis of the liver, the liver wrinkle and liver cancer.
+Moon Kutsar, an epidemiology adviser at the Department of Health, says acute hepatitis disease is the same for all types of liver inflammation - fever, fatigue, appetite, nausea, vomiting, abdominal pain, thin excrement, dark urine, muscle and joint pain, and the yellowness of the skin and mucus.
+The popular name for liver inflammation also comes from the latest disease.
+In children, hepatitis can go without signs of disease.
+Different types of inflammation can only be determined on the basis of data from laboratory studies.
+Extreme hepatitis can transition into chronic hepatitis and run for decades without the disease, which means a person may not know anything about their dangerous liver-damaging disease.
+Mr Kutsar points out different forms of hepatitis and describes their progress more closely.
+Hepatitis A viruses spread from sick people and infect us by eating contaminated food or drinking water, by sex, from the stools of an infected person to their hands and from their hands to their arms, surfaces, objects, objects, mouth and drug use.
+Hepatitis A to be infected, or at-risk group, family members and carers of the disease, people with chronic liver disease, people having sex with infected people, men having sex with men, drug addicts, travelers visiting countries with hepatitis A high spread.
+Infectiousness can be prevented by vaccination, in particular vaccination for people travelling and at risk of hepatitis A.
+In addition, daily hygiene compliance is important: wash or disinfect your hands, washing all fruit and vegetables before using it for food.
+Hepatitis B viruses are spread when a sick person is exposed to blood, injecting drugs, tattooing, hole-in-the-wall, using blood-contaminated creatures (toothbrushes, waste products), donor blood, having sex with a hepatitis-cheek person, and from a hepatitis patient to the foetus/born.
+The risk group for hepatitis B infection includes injection drug users, sex partners of an infected person, men having sex with men, newborns from an infected mother, sick family members and caregivers, health, rescue workers and police officers exposed to blood and other bodily fluids, and travelers visiting countries with high hepatitis B.
+People can be vaccinated to prevent hepatitis B; in particular, people at risk have been recommended, as well as those with chronic liver disease, HIV infection, sexually transmitted diseases and diabetes.
+Other preventive measures for hepatitis B include: avoiding the use of foreign hygiene and manicure products, other sharpeners and syringes, tattooing and sniffing, and using condoms in cases of infectious sex or avoiding sexual risky behaviour.
+Vaccinating hepatitis B is part of the national immunisation scheme in Estonia and free for children.
+Hepatitis C viruses are spread when exposed to the blood of a sick person, injecting drugs, tattooing, skulls, using blood-contaminated creatures, donor blood, having sex with a hepatitis person, and from hepatitis-stricken mother to foetus/benimorous.
+The risk group for hepatitis C infection includes injection drug users, sex partners of infected people, men having sex with men, newborns of an infected mother, sick family members and caregivers, health care workers and police officers exposed to blood and other bodily fluids, people with HIV infection, and travelers visiting countries with high hepatitis C.
+The prevention measure of hepatitis C is: avoiding the use of foreign hygiene and manicure products, other sharpeners and syringe nucleus, tattooing and sniffing, and using condoms in the event of infectious sex.
+There is no vaccine against hepatitis C.
+Hepatitis D is caused by a hepatitis D virus that reproduces in the presence of the hepatitis B virus.
+As a result, hepatitis D infection occurs in hepatitis B or a super infection in chronic hepatitis B patients.
+Hepatitis D viruses are spread through contact with blood and other bodily fluids, with them contaminated needles, sexually and from the rarely infected mother to the fetus.
+The risk group for hepatitis D is chronic hepatitis B virus carriers and people with no immunity against hepatitis B.
+An effective preventive measure is vaccination with the hepatitis B vaccine, which also protects people from hepatitis D infection.
+Hepatitis viruses spread through fecal-oridal drinking water and food, including eating low-heated beef, fish and sea cucumbers, donor blood, commonly used needles and infected mother to foetus.
+Passengers can become infected in countries with hepatitis E high rates.
+Hepatitis prevention measures include meeting hygiene requirements: wash or disinfect your hands after going to the toilet, before cooking and eating, after caring for the patient.
+Trees and vegetables to wash before consumption, avoid eating low-heated beef, fish and seafood, drink only safe drinking water and avoid drug use.
+While the rivals tried to sprint off the four-time Olympic champion in the final round, 34-year-old Farah found strength in the final round and won in 26.49.51.
+Farah didn't think long, pulling his wife Tania and children along the way with him after the finish.
+It was a special moment for me.
+I miss my family very much.
+Being on the track with them was wonderful," Farah told reporters.
+Farah is aiming for a fifth title race in London in a row with a golden duo of the 5,000 and 10,000 metres.
+Anything is possible if you believe in it.
+Despite the title, Anne-Marie O'Connor's "Dam in Gold; Gustav Klimt's masterpiece, the extraordinary story of Adele Bloch-Bauer's portrait," delves much deeper into the origin story of one art work in the late 19th century and early 20th century Vienna's cultural life.
+But even more deeply in history.
+The awesome amount of information would have been worn out, perhaps a louder cut, a narrower subject that allowed the portrait allowed in the title to become more of an influence.
+There would be two books between the covers: the story of Adele Bloch-Bauer, depicted in one cover, and the story of Adele Bloch-Bauer, portrayed in her painting "Daam in Gold," and a much larger and comprehensive historical book about the esteemed Jewish family and the German occupation, along with its after-effects in Austria.
+The first third of the book leads to the cultural life of Vienna in the midst of a bustling Vienna, and whoever is in the Austrian capital can imagine, without the slightest effort, how life went around Ringstrasse more than a hundred years ago, or how everyone turned their heads around Central Cafe when Klimt stepped in.
+The concentration of cultural figures was high in one of Europe's richest cities, and when you see a familiar name in the book, you feel like a more grammar culture.
+At the same time, for example, the fact that Sigmund Freud operated in a city where incurable syphilis was rampant and had the highest suicide rate in Europe is not an added to the story's development.
+Or, perhaps, every pair of brushstrokes adds colours to the cultural life of the early 20th century in Vienna.
+The dream of a trip to the Soviet Union
+In the last decades of the 19th century, the number of Jews in Vienna had exploded, becoming the largest Jewish community in Western Europe.
+At the turn of the century, almost one in ten residents of Vienna was a Jew.
+Adele's parents were also newcomers to Vienna, but by the time Adele married twice to open a Czech sugar magnate, Ferdinand Bloch, and Klimt was posing for his famous paintings, his father's bank had become the seventh largest bank in the Habsburg empire.
+But Adelet didn't draw all the glamorous life to which she belonged.
+If you look at "Dami's gold," it's hard to believe that towards the end of her life, this great lady became infected with socialism and dreamed of a trip to the Soviet Union.
diff --git a/tests/decoder/intgemm/fbgemm_intgemm_8bit.avx512.expected.bleu b/tests/decoder/intgemm/fbgemm_intgemm_8bit.avx512.expected.bleu
new file mode 100644
index 0000000..f714aaf
--- /dev/null
+++ b/tests/decoder/intgemm/fbgemm_intgemm_8bit.avx512.expected.bleu
@@ -0,0 +1 @@
+BLEU+case.mixed+numrefs.1+smooth.exp+tok.13a+version.1.2.12 = 31.1 65.9/38.8/24.9/16.1 (BP = 0.978 ratio = 0.978 hyp_len = 2776 ref_len = 2838)
diff --git a/tests/decoder/intgemm/intgemm_16bit.avx.expected b/tests/decoder/intgemm/intgemm_16bit.avx.expected
new file mode 100644
index 0000000..96ddeb1
--- /dev/null
+++ b/tests/decoder/intgemm/intgemm_16bit.avx.expected
@@ -0,0 +1,100 @@
+Four members of the Kemerovo group detained in Estonia and Spain
+Slava Gulevich, the leader of the so-called Kemerovo group in the Estonian underworld and is known in the criminal world as Slava Kemerovsky, was detained by police in Spain, according to the Post.
+Gulevich, who was detained in Spain, was arrested with court permission.
+Yesterday, a court also took three suspects detained in Estonia into custody.
+The suspect is said to be members of the so-called Kemerovo Crime Society between the ages of 27 and 57, who mainly commit drug offences.
+The alleged head of a criminal association has been detained in Mijas, Malaga province, Spain.
+Three men were arrested on suspicion in Estonia, one of whom is a leading figure in the criminal association, according to the data collected, and two are members of the criminal association.
+The data collected indicate that the tasks and roles were clearly distributed in the criminal community.
+The purpose of the criminal association's activities was to commit drug crimes and thus generate criminal proceeds," said Mr Verte, head of pretrial proceedings in the criminal case and state prosecutor.
+"We do not rule out an increase in the number of suspects in this criminal case," the prosecutor added.
+These are people who have been in the interest of law enforcement in the past, and some have served sentences for drug crimes.
+Verte stressed that cooperation with Spanish counterparts had been important throughout the investigation.
+"International cooperation has become commonplace for us, and this week's operation shows the success of cooperation," prosecutor Verte said.
+Ago Leis, head of the Central Criminal Police Service, said the arrests were preceded by a probe into a year-and-a-half year-and-a-half.
+"In the first half of the year, the long-term work materialised and we detained suspects of crimes in Estonia and Spain at the same time," he said.
+Leis added that Central Criminal Police officers were assisting in their arrest in Spain.
+For years we have had good contact and understanding with the Spanish police and the Civil Guard.
+These arrests are yet another message to criminals that we can get them from the other end of Europe," Leis said.
+The information gathered so far clearly indicates that the men suspected of continuing to commit new crimes while at large, so the prosecution requested their arrest and the court approved it.
+A man arrested in Spain is awaiting transfer to Estonia.
+Property, vehicles and cash have been seized as part of this criminal case to ensure confiscation.
+The pre-trial proceedings in the case are carried out by the Central Criminal Police Organised Crime Bureau and led by the Crown Prosecution Service.
+Slava Gulevich was convicted by a district court in 2005 of racketeering and sentenced to five years in prison.
+In the middle of the last decade, Gulevich was considered the second most important man in the Estonian criminal world after then underworld leader Nikolai Tarankov.
+Gulevich, from Kemerovo, rose to prominence in the Estonian underworld in the early 1990s when he began extortion in Tallinn.
+He allegedly taxi drivers and prostitutes operating at various hotels and demanded monthly roof tax from businessmen.
+International joint operations, confiscations of criminal proceeds and court rulings that have entered into force confirm that the fight against organised crime is effective.
+For example, the latest court rulings, eight defendants separated from the so-called Dikayev Criminal Association criminal case who were ordered to pay BGN 80,000 for the proceeds of criminal damage, or the judgment of nine individuals, in 2006 that Igor Aleynikov established a criminal association aimed at the illegal trade in cigarettes and the committing of crimes related to human trafficking in East Virginia and the South in Estonia.
+Confirmed criminal proceeds there are around 71,500 euros.
+In these criminal matters, it has ensured that police officers exchange information and evidence with foreign colleagues every day and, if necessary, carry out actions together in any European Union country.
+Civil rights group warns against travel to Missouri
+The National Association for the Advancement of Colored People (NAACP) has warned black people traveling to Missouri against discriminatory policies and racist attacks in the state.
+The group's statement reads: "A NAACP travel note issued for the state of Midsugar, which runs until August 28, 2017, invites all African-American travelers, visitors and Missourians to be particularly attentive and extremely careful as they move around the state, taking into account the entire suspicious racial events that have recently taken place across the state and are also mentioned here."
+The NAACP said the group urged the travel warning to issue both a recent Missouri law that makes it harder to win discrimination lawsuits and the fact that the state's law enforcement agencies target unequally largely minorities.
+"People's civil rights are being violated.
+They are pulled to the side of the road because of the color of their skin, beaten or killed," Rod Chapel, president of the Missouri branch of the NAACP, told The Kansas City Star.
+'We've never had so close complaints before.'
+It is the first such warning the organization has issued about the U.S. state.
+The group cited events such as racist insults at the University of Missouri and the death of Tory Sanders, a 28-year-old black man from Tennessee.
+Sanders died in suspicious circumstances earlier this year after he ran out of petrol while driving through the state and was taken into custody by Missouri police without being charged with a crime.
+In addition, the note points to a recent report by the Missouri Attorney General, which shows that in the state, black drivers are 75% more likely to be stopped than white people.
+"The alarm is designed to make people aware and warn their families, friends and co-workers about what could happen in Missouri," Chapel said.
+"People have to be prepared, whether it's taking bail money or informing relatives that they're going through the state," he said.
+According to the latest data from the FBI's hate crime reporting program, Missouri documented 100 hate crimes in 2015, putting the state 16th in the state's penetrating number of similar violations.
+The travel warning is also a response to Missouri's new law, which makes it difficult for the company to sue over discrimination in search of housing or work.
+The American Civil Liberties Union (American Civil Liberties Union) had previously issued travel notices for Texas and Arizona after those states passed immigration laws that required local authorities to arrest people for immigration violations because the ACLU said it would increase racial profiling.
+Typically, travel warnings are issued by the State Department for other countries, but recently interest groups have begun to use the measure as a counter-reaction to certain intra-U.S. laws and trends.
+Hepatitis: what would anyone know about different forms of this serious disease?
+Hepatitis, or liver inflammation, can be caused by five different - A, B, C, D and E viruses.
+All these viruses trigger acute inflammation of liver tissue.
+However, chronic hepatitis B and C, which can develop into cirrhosis of the liver, or liver wrinkles and liver cancer, is a poor cost.
+Moo Kutsar, an epidemiology adviser at the Department of Health, says acute hepatitis symptoms are the same for all types of liver inflammation - fever, fatigue, appetite, nasalty, vomiting, abdominal pain, smear excrement, dark urine, muscle and joint pain, and the yellowing of the skin and mucus.
+The popular name for liver inflammation also comes from the latest disease.
+In children, hepatitis can progress without signs of disease.
+Different types of inflammation can only be determined on the basis of data from laboratory studies.
+Extreme hepatitis can switch to chronic hepatitis and run for decades without signs of disease, meaning a person may not know anything about their dangerous liver-damaging disease.
+Mr Kutsar points out different forms of hepatitis and describes their progress more closely.
+Hepatitis A viruses spread from sick people and infect us by eating contaminated food or drinking water, through sex, from the stools of an infected person to their hands and hands to their hands, surfaces, objects, mouths and drug use.
+Family members and carers of hepatitis infection, people with chronic liver disease, people having sex with infected people, men having sex with men, drug addicts, travelers visiting countries with hepatitis A high spread.
+Infectiousness can be prevented by vaccination, in particular for people travelling at risk of vaccination and at risk of hepatitis A.
+In addition, daily hygiene compliance is important: wash or disinfect your hands, wash all fruit and vegetables before using them for food.
+Hepatitis B viruses are spread when exposed to the blood of a sick person, injecting drugs, tattooing, hole-in-aged, blood-contaminated creatures (toothbrushes, squatting tools), donor blood, having sex with a hepatitis-chemist, hepatitis Cathedential person, and from a hepatitis-stricken mother to the foelicen/born.
+The risk group for hepatitis B infection includes injection drug addicts, sex partners of an infected person, men having sex with men, newborns of an infected mother, sick family members and carers, health, rescue workers and police officers exposed to blood and other bodily fluids, and travelers visiting countries with high hepatitis B.
+People can be vaccinated to prevent hepatitis B; in particular, people at risk have been recommended, as well as those with chronic liver disease, HIV infection, sexually transmitted diseases and diabetes.
+Other preventive measures for hepatitis B include: avoiding the use of foreign hygiene and manicure products, other sharpeners and needles, tattooing and hole-in-the-wall, and the use of condoms in the event of infectious sex or avoiding sexual risky behaviour.
+Vaccination against hepatitis B is part of the national immunisation scheme in Estonia and free for children.
+Hepatitis C viruses are spread when exposed to the blood of a sick person, injecting drugs, tattooing, skull, using blood-contaminated creatures, donor blood, having sex with a hepatitis-maker, and from hepatitis to mother to foetus/best.
+The risk group for hepatitis C infection includes injection drug addicts, sex partners of an infected person, men having sex with men, newborns of an infected mother, sick family members and carers, health, rescue workers and police officers exposed to blood and other bodily fluids, HIV infections, and travelers visiting countries with high hepatitis C.
+The prevention measure of hepatitis C is: avoiding the use of foreign hygiene and manicure products, other sharpeners and syringes and needles, tattooing and sniffing, and using condoms for condom-threatening sex.
+There is no vaccine against hepatitis C.
+Hepatitis D is caused by hepatitis D virus, which reproduces in the presence of hepatitis B virus.
+As a result, hepatitis D infection occurs in hepatitis B or as a super infection in chronic hepatitis B patients.
+Hepatitis D viruses are spread through contact with blood and other bodily fluids, with contaminated needles, sexually and rarely infected mothers to the fetus.
+Hepatitis D is a risk group for chronic hepatitis B virus carriers and people with no immunity against hepatitis B.
+An effective preventive measure is vaccination with the hepatitis B vaccine, which also protects people from infection with the hepatitis D virus.
+Hepatitis viruses spread through fetal-oral drinking water and food, including eating low-heated beef, fish and sea cucumbers, donor blood, joint-use syringes and infected mothers to fetus.
+Passengers may become infected in countries with hepatitis E high disease.
+Hepatitis prevention measures include meeting hygiene requirements: wash or disinfect your hands after going to the toilet, before cooking and eating, after caring for the sick.
+Wash fruit and vegetables before consumption, avoid eating low-heated beef, fish and seafood, drink only safe drinking water and avoid drug use.
+While rivals tried to sprint off the four-time Olympic champion in the final round, 34-year-old Farah found strength in the final round and won in 26.49.51.
+Farah didn't think long, pulling his wife Tania and children along the way with him after the finish.
+It was a special moment for me.
+I very much miss my family.
+Being on the track with them was wonderful," Farah told reporters.
+Farah is aiming for a fifth title race in London in a row with a golden duo of 5,000 and 10,000 metres.
+Anything is possible if you believe in it.
+Despite the title, Anne-Marie O'Connor's "Daam in Gold; Gustav Klimt's masterpiece, Adele Bloch-Bauer's Portrait Extraoral Story," delves much deeper into the origin story of one artwork from the birth story of one artwork to the cultural life of late 19th and early 20th-century Vienna.
+But even more in history.
+The awesome amount of information would perhaps have been worn out, perhaps a louder cut, a narrower subject that allowed the portrait allowed in the title to become more of an impact.
+Today, there would be two books on the same cover: the story of Gustav Klimt and his painting "Daam in Gold," Adele Bloch-Bauer, and a much larger and more comprehensive historical book about the esteemed Jewish families and the German occupation, along with its aftermath in Austria.
+The first third of the book leads to the cultural life of Vienna in the midst of a bustling Vienna, and who have entered the Austrian capital, you can imagine, without the slightest effort, how life went around Ringstrasse more than a hundred years ago, or how everyone turned their heads in the Central Cafe when Klimt stepped in.
+The concentration of cultural figures was high in one of Europe's richest cities, and when you see a familiar name in the book, you feel more cultured.
+At the same time, for example, the fact that Sigmund Freud operated in a city where incurable syphilis was rampant and was Europe's highest suicide rate, doesn't seem to add anything to the story's development.
+Or, perhaps, every pair of brushstrokes adds colours to the cultural life of the early 20th century in Vienna.
+The dream of a trip to the Soviet Union
+In the last decades of the 19th century, the number of Jews in Vienna had exploded, becoming the largest Jewish community in Western Europe.
+At the turn of the century, almost one in ten residents of Vienna was a Jew.
+Adele's parents were newcomers to Vienna, too, but by the time Adele married her two-time Open Czech sugar magnate Ferdinand Bloch and Klimt for her famous paintings, her father's bank had become the seventh-largest bank in the Habsburg empire.
+But Adelet didn't draw all the glamorous life to which she belonged.
+If you look at "Damid in gold," it's hard to believe that towards the end of her life, this great lady became infected with socialism and dreamed of a trip to the Soviet Union.
diff --git a/tests/decoder/intgemm/intgemm_16bit.avx.expected.bleu b/tests/decoder/intgemm/intgemm_16bit.avx.expected.bleu
new file mode 100644
index 0000000..23071d3
--- /dev/null
+++ b/tests/decoder/intgemm/intgemm_16bit.avx.expected.bleu
@@ -0,0 +1 @@
+BLEU+case.mixed+numrefs.1+smooth.exp+tok.13a+version.1.2.12 = 30.5 66.3/38.6/24.4/15.8 (BP = 0.967 ratio = 0.968 hyp_len = 2747 ref_len = 2838)
diff --git a/tests/decoder/intgemm/intgemm_16bit.avx2.expected b/tests/decoder/intgemm/intgemm_16bit.avx2.expected
new file mode 100644
index 0000000..84e9c8d
--- /dev/null
+++ b/tests/decoder/intgemm/intgemm_16bit.avx2.expected
@@ -0,0 +1,100 @@
+Four members of the Kemerovo group detained in Estonia and Spain
+Slava Gulevich, the leader of the so-called Kemerovo group in the Estonian underworld and is known in the criminal world as Slava Kemerovsky, was detained by police in Spain, according to the Post.
+Gulevich, who was detained in Spain, was arrested with court permission.
+Yesterday, a court also took three suspects detained in Estonia into custody.
+The suspect is said to be members of the so-called Kemerovo Crime Society between the ages of 27 and 57, who mainly commit drug offences.
+The alleged head of a criminal association has been detained in Mijas, Malaga province, Spain.
+Three men were arrested on suspicion in Estonia, one of whom is a leading figure in the criminal association, according to the data collected, and two are members of the criminal association.
+The data collected indicate that the tasks and roles were clearly distributed in the criminal community.
+The purpose of the criminal association's activities was to commit drug crimes and thus generate criminal proceeds," said Mr Verte, head of pretrial proceedings in the criminal case and state prosecutor.
+"We do not rule out an increase in the number of suspects in this criminal case," the prosecutor added.
+These are people who have been in the interest of law enforcement in the past, and some have served sentences for drug crimes.
+Verte stressed that cooperation with Spanish counterparts had been important throughout the investigation.
+"International cooperation has become commonplace for us, and this week's operation shows the success of cooperation," prosecutor Verte said.
+Ago Leis, head of the Central Criminal Police Service, said the arrests were preceded by a probe into a year-and-a-half year-and-a-half.
+"In the first half of the year, the long-term work materialised and we detained suspects of crimes in Estonia and Spain at the same time," he said.
+Leis added that Central Criminal Police officers were assisting in their arrest in Spain.
+For years we have had good contact and understanding with the Spanish police and the Civil Guard.
+These arrests are yet another message to criminals that we can get them from the other end of Europe," Leis said.
+The information gathered so far clearly indicates that the men suspected of continuing to commit new crimes while at large, so the prosecution requested their arrest and the court approved it.
+A man arrested in Spain is awaiting transfer to Estonia.
+Property, vehicles and cash have been seized as part of this criminal case to ensure confiscation.
+The pre-trial proceedings in the case are carried out by the Central Criminal Police Organised Crime Bureau and led by the Crown Prosecution Service.
+Slava Gulevich was convicted by a district court in 2005 of racketeering and sentenced to five years in prison.
+In the middle of the last decade, Gulevich was considered the second most important man in the Estonian criminal world after then underworld leader Nikolai Tarankov.
+Gulevich, from Kemerovo, rose to prominence in the Estonian underworld in the early 1990s when he began extortion in Tallinn.
+He allegedly taxi drivers and prostitutes operating at various hotels and demanded monthly roof tax from businessmen.
+International joint operations, confiscations of criminal proceeds and court rulings that have entered into force confirm that the fight against organised crime is effective.
+For example, the latest court rulings, eight defendants separated from the so-called Dikayev Criminal Association criminal case who were ordered to pay BGN 80,000 for the proceeds of criminal damage, or the judgment of nine individuals, in 2006 that Igor Aleynikov established a criminal association aimed at the illegal trade in cigarettes and the committing of crimes related to human trafficking in East Virginia and the South in Estonia.
+Confirmed criminal proceeds there are around 71,500 euros.
+In these criminal matters, it has ensured that police officers exchange information and evidence with foreign colleagues every day and, if necessary, carry out actions together in any European Union country.
+Civil rights group warns against travel to Missouri
+The National Association for the Advancement of Colored People (NAACP) has warned black people traveling to Missouri against discriminatory policies and racist attacks in the state.
+The group's statement reads: "A NAACP travel note issued for the state of Midsugar, which runs until August 28, 2017, invites all African-American travelers, visitors and Missourians to be particularly attentive and extremely careful as they move around the state, taking into account the entire suspicious racial events that have recently taken place across the state and are also mentioned here."
+The NAACP said the group urged the travel warning to issue both a recent Missouri law that makes it harder to win discrimination lawsuits and the fact that the state's law enforcement agencies target unequally largely minorities.
+"People's civil rights are being violated.
+They are pulled to the side of the road because of the color of their skin, beaten or killed," Rod Chapel, president of the Missouri branch of the NAACP, told The Kansas City Star.
+'We've never had so close complaints before.'
+It is the first such warning the organization has issued about the U.S. state.
+The group cited events such as racist insults at the University of Missouri and the death of Tory Sanders, a 28-year-old black man from Tennessee.
+Sanders died in suspicious circumstances earlier this year after he ran out of petrol while driving through the state and was taken into custody by Missouri police without being charged with a crime.
+In addition, the note points to a recent report by the Missouri Attorney General, which shows that in the state, black drivers are 75% more likely to be stopped than white people.
+"The alarm is designed to make people aware and warn their families, friends and co-workers about what could happen in Missouri," Chapel said.
+"People have to be prepared, whether it's taking bail money or informing relatives that they're going through the state," he said.
+According to the latest data from the FBI's hate crime reporting program, Missouri documented 100 hate crimes in 2015, putting the state 16th in the state's penetrating number of similar violations.
+The travel warning is also a response to Missouri's new law, which makes it difficult for the company to sue over discrimination in search of housing or work.
+The American Civil Liberties Union (American Civil Liberties Union) had previously issued travel notices for Texas and Arizona after those states passed immigration laws that required local authorities to arrest people for immigration violations because the ACLU said it would increase racial profiling.
+Typically, travel warnings are issued by the State Department for other countries, but recently interest groups have begun to use the measure as a counter-reaction to certain intra-U.S. laws and trends.
+Hepatitis: what would anyone know about different forms of this serious disease?
+Hepatitis, or liver inflammation, can be caused by five different - A, B, C, D and E viruses.
+All these viruses trigger acute inflammation of liver tissue.
+However, chronic hepatitis B and C, which can develop into cirrhosis of the liver, or liver wrinkles and liver cancer, is a poor cost.
+Moo Kutsar, an epidemiology adviser at the Department of Health, says acute hepatitis symptoms are the same for all types of liver inflammation - fever, fatigue, appetite, nasalty, vomiting, abdominal pain, smear excrement, dark urine, muscle and joint pain, and the yellowing of the skin and mucus.
+The popular name for liver inflammation also comes from the latest disease.
+In children, hepatitis can progress without signs of disease.
+Different types of inflammation can only be determined on the basis of data from laboratory studies.
+Extreme hepatitis can switch to chronic hepatitis and run for decades without signs of disease, meaning a person may not know anything about their dangerous liver-damaging disease.
+Mr Kutsar points out different forms of hepatitis and describes their progress more closely.
+Hepatitis A viruses spread from sick people and infect us by eating contaminated food or drinking water, through sex, from the stools of an infected person to their hands and hands to their hands, surfaces, objects, mouths and drug use.
+Family members and carers of hepatitis infection, people with chronic liver disease, people having sex with infected people, men having sex with men, drug addicts, travelers visiting countries with hepatitis A high spread.
+Infectiousness can be prevented by vaccination, in particular for people travelling at risk of vaccination and at risk of hepatitis A.
+In addition, daily hygiene compliance is important: wash or disinfect your hands, wash all fruit and vegetables before using them for food.
+Hepatitis B viruses are spread when exposed to the blood of a sick person, injecting drugs, tattooing, hole-in-aged, blood-contaminated creatures (toothbrushes, squatting tools), donor blood, having sex with a hepatitis-chemist, hepatitis Cathedential person, and from a hepatitis-stricken mother to the foelicen/born.
+The risk group for hepatitis B infection includes injection drug addicts, sex partners of an infected person, men having sex with men, newborns of an infected mother, sick family members and carers, health, rescue workers and police officers exposed to blood and other bodily fluids, and travelers visiting countries with high hepatitis B.
+People can be vaccinated to prevent hepatitis B; in particular, people at risk have been recommended, as well as those with chronic liver disease, HIV infection, sexually transmitted diseases and diabetes.
+Other preventive measures for hepatitis B include: avoiding the use of foreign hygiene and manicure products, other sharpeners and needles, tattooing and hole-in-the-wall, and the use of condoms in the event of infectious sex or avoiding sexual risky behaviour.
+Vaccination against hepatitis B is part of the national immunisation scheme in Estonia and free for children.
+Hepatitis C viruses are spread when exposed to the blood of a sick person, injecting drugs, tattooing, skull, using blood-contaminated creatures, donor blood, having sex with hepatitis Cathedral, and from hepatitis to mother to foetus/best.
+The risk group for hepatitis C infection includes injection drug addicts, sex partners of an infected person, men having sex with men, newborns of an infected mother, sick family members and carers, health, rescue workers and police officers exposed to blood and other bodily fluids, HIV infections, and travelers visiting countries with high hepatitis C.
+The prevention measure of hepatitis C is: avoiding the use of foreign hygiene and manicure products, other sharpeners and syringes and needles, tattooing and sniffing, and using condoms for condom-threatening sex.
+There is no vaccine against hepatitis C.
+Hepatitis D is caused by hepatitis D virus, which reproduces in the presence of hepatitis B virus.
+As a result, hepatitis D infection occurs in hepatitis B or as a super infection in chronic hepatitis B patients.
+Hepatitis D viruses are spread through contact with blood and other bodily fluids, with contaminated needles, sexually and rarely infected mothers to the fetus.
+Hepatitis D is a risk group for chronic hepatitis B virus carriers and people with no immunity against hepatitis B.
+An effective preventive measure is vaccination with the hepatitis B vaccine, which also protects people from infection with the hepatitis D virus.
+Hepatitis viruses spread through fetal-oral drinking water and food, including eating low-heated beef, fish and sea cucumbers, donor blood, joint-use syringes and infected mothers to fetus.
+Passengers may become infected in countries with hepatitis E high disease.
+Hepatitis prevention measures include meeting hygiene requirements: wash or disinfect your hands after going to the toilet, before cooking and eating, after caring for the sick.
+Wash fruit and vegetables before consumption, avoid eating low-heated beef, fish and seafood, drink only safe drinking water and avoid drug use.
+While rivals tried to sprint off the four-time Olympic champion in the final round, 34-year-old Farah found strength in the final round and won in 26.49.51.
+Farah didn't think long, pulling his wife Tania and children along the way with him after the finish.
+It was a special moment for me.
+I very much miss my family.
+Being on the track with them was wonderful," Farah told reporters.
+Farah is aiming for a fifth title race in London in a row with a golden duo of 5,000 and 10,000 metres.
+Anything is possible if you believe in it.
+Despite the title, Anne-Marie O'Connor's "Daam in Gold; Gustav Klimt's masterpiece, Adele Bloch-Bauer's Portrait Extraoral Story," delves much deeper into the origin story of one artwork from the birth story of one artwork to the cultural life of late 19th and early 20th-century Vienna.
+But even more in history.
+The awesome amount of information would perhaps have been worn out, perhaps a louder cut, a narrower subject that allowed the portrait allowed in the title to become more of an impact.
+Today, there would be two books on the same cover: the story of Gustav Klimt and his painting "Daam in Gold," Adele Bloch-Bauer, and a much larger and more comprehensive historical book about the esteemed Jewish families and the German occupation, along with its aftermath in Austria.
+The first third of the book leads to the cultural life of Vienna in the midst of a bustling Vienna, and who have entered the Austrian capital, you can imagine, without the slightest effort, how life went around Ringstrasse more than a hundred years ago, or how everyone turned their heads in the Central Cafe when Klimt stepped in.
+The concentration of cultural figures was high in one of Europe's richest cities, and when you see a familiar name in the book, you feel more cultured.
+At the same time, for example, the fact that Sigmund Freud operated in a city where incurable syphilis was rampant and was Europe's highest suicide rate, doesn't seem to add anything to the story's development.
+Or, perhaps, every pair of brushstrokes adds colours to the cultural life of the early 20th century in Vienna.
+The dream of a trip to the Soviet Union
+In the last decades of the 19th century, the number of Jews in Vienna had exploded, becoming the largest Jewish community in Western Europe.
+At the turn of the century, almost one in ten residents of Vienna was a Jew.
+Adele's parents were newcomers to Vienna, too, but by the time Adele married her two-time Open Czech sugar magnate Ferdinand Bloch and Klimt for her famous paintings, her father's bank had become the seventh-largest bank in the Habsburg empire.
+But Adelet didn't draw all the glamorous life to which she belonged.
+If you look at "Damid in gold," it's hard to believe that towards the end of her life, this great lady became infected with socialism and dreamed of a trip to the Soviet Union.
diff --git a/tests/decoder/intgemm/intgemm_16bit.avx2.expected.bleu b/tests/decoder/intgemm/intgemm_16bit.avx2.expected.bleu
new file mode 100644
index 0000000..23071d3
--- /dev/null
+++ b/tests/decoder/intgemm/intgemm_16bit.avx2.expected.bleu
@@ -0,0 +1 @@
+BLEU+case.mixed+numrefs.1+smooth.exp+tok.13a+version.1.2.12 = 30.5 66.3/38.6/24.4/15.8 (BP = 0.967 ratio = 0.968 hyp_len = 2747 ref_len = 2838)
diff --git a/tests/decoder/intgemm/intgemm_16bit.avx512.expected b/tests/decoder/intgemm/intgemm_16bit.avx512.expected
new file mode 100644
index 0000000..288b9be
--- /dev/null
+++ b/tests/decoder/intgemm/intgemm_16bit.avx512.expected
@@ -0,0 +1,100 @@
+Four members of the Kemerovo group detained in Estonia and Spain
+Slava Gulevich, the leader of the so-called Kemerovo group in the Estonian underworld and is known in the criminal world as Slava Kemerovsky, was detained by police in Spain, according to the Post.
+Gulevich, who was detained in Spain, was arrested with court permission.
+Yesterday, a court also took three suspects detained in Estonia into custody.
+The suspect is said to be members of the so-called Kemerovo Crime Society between the ages of 27 and 57, who mainly commit drug offences.
+The alleged head of a criminal association has been detained in Mijas, Malaga province, Spain.
+Three men were arrested on suspicion in Estonia, one of whom is a leading figure in the criminal association, according to the data collected, and two are members of the criminal association.
+The data collected indicate that the tasks and roles were clearly distributed in the criminal community.
+The purpose of the criminal association's activities was to commit drug crimes and thus generate criminal proceeds," said Mr Verte, head of pretrial proceedings in the criminal case and state prosecutor.
+"We do not rule out an increase in the number of suspects in this criminal case," the prosecutor added.
+These are people who have been in the interest of law enforcement in the past, and some have served sentences for drug crimes.
+Verte stressed that cooperation with Spanish counterparts had been important throughout the investigation.
+"International cooperation has become commonplace for us, and this week's operation shows the success of cooperation," prosecutor Verte said.
+Ago Leis, head of the Central Criminal Police Service, said the arrests were preceded by a probe into a year-and-a-half year-and-a-half.
+"In the first half of the year, the long-term work materialised and we detained suspects of crimes in Estonia and Spain at the same time," he said.
+Leis added that Central Criminal Police officers were assisting in their arrest in Spain.
+For years we have had good contact and understanding with the Spanish police and the Civil Guard.
+These arrests are yet another message to criminals that we can get them from the other end of Europe," Leis said.
+The information gathered so far clearly indicates that the men suspected of continuing to commit new crimes while at large, so the prosecution requested their arrest and the court approved it.
+A man arrested in Spain is awaiting transfer to Estonia.
+Property, vehicles and cash have been seized as part of this criminal case to ensure confiscation.
+The pre-trial proceedings in the case are carried out by the Central Criminal Police Organised Crime Bureau and led by the Crown Prosecution Service.
+Slava Gulevich was convicted by a district court in 2005 of racketeering and sentenced to five years in prison.
+In the middle of the last decade, Gulevich was considered the second most important man in the Estonian criminal world after then underworld leader Nikolai Tarankov.
+Gulevich, from Kemerovo, rose to prominence in the Estonian underworld in the early 1990s when he began extortion in Tallinn.
+He allegedly taxi drivers and prostitutes operating at various hotels and demanded monthly roof tax from businessmen.
+International joint operations, confiscations of criminal proceeds and court rulings that have entered into force confirm that the fight against organised crime is effective.
+For example, the latest court rulings, eight defendants separated from the so-called Dikayev Criminal Association criminal case who were ordered to pay BGN 80,000 for the proceeds of criminal damage, or the judgment of nine individuals, in 2006 that Igor Aleynikov established a criminal association aimed at the illegal trade in cigarettes and the committing of crimes related to human trafficking in East Virginia and the South in Estonia.
+Confirmed criminal proceeds there are around 71,500 euros.
+In these criminal matters, it has ensured that police officers exchange information and evidence with foreign colleagues every day and, if necessary, carry out actions together in any European Union country.
+Civil rights group warns against travel to Missouri
+The National Association for the Advancement of Colored People (NAACP) has warned black people traveling to Missouri against discriminatory policies and racist attacks in the state.
+The group's statement reads: "A NAACP travel note issued for the state of Midsugar, which runs until August 28, 2017, invites all African-American travelers, visitors and Missourians to be particularly attentive and extremely careful as they move around the state, taking into account the entire suspicious racial events that have recently taken place across the state and are also mentioned here."
+The NAACP said the group urged the travel warning to issue both a recent Missouri law that makes it harder to win discrimination lawsuits and the fact that the state's law enforcement agencies target unequally largely minorities.
+"People's civil rights are being violated.
+They are pulled to the side of the road because of the color of their skin, beaten or killed," Rod Chapel, president of the Missouri branch of the NAACP, told The Kansas City Star.
+'We've never had so close complaints before.'
+It is the first such warning the organization has issued about the U.S. state.
+The group cited events such as racist insults at the University of Missouri and the death of Tory Sanders, a 28-year-old black man from Tennessee.
+Sanders died in suspicious circumstances earlier this year after he ran out of petrol while driving through the state and was taken into custody by Missouri police without being charged with a crime.
+In addition, the note points to a recent report by the Missouri Attorney General, which shows that in the state, black drivers are 75% more likely to be stopped than white people.
+"The alarm is designed to make people aware and warn their families, friends and co-workers about what could happen in Missouri," Chapel said.
+"People have to be prepared, whether it's taking bail money or informing relatives that they're going through the state," he said.
+According to the latest data from the FBI's hate crime reporting program, Missouri documented 100 hate crimes in 2015, putting the state 16th in the state's penetrating number of similar violations.
+The travel warning is also a response to Missouri's new law, which makes it difficult for the company to sue over discrimination in search of housing or work.
+The American Civil Liberties Union (American Civil Liberties Union) had previously issued travel notices for Texas and Arizona after those states passed immigration laws that required local authorities to arrest people for immigration violations because the ACLU said it would increase racial profiling.
+Typically, travel warnings are issued by the State Department for other countries, but recently interest groups have begun to use the measure as a counter-reaction to certain intra-U.S. laws and trends.
+Hepatitis: what would anyone know about different forms of this serious disease?
+Hepatitis, or liver inflammation, can be caused by five different - A, B, C, D and E viruses.
+All these viruses trigger acute inflammation of liver tissue.
+However, chronic hepatitis B and C, which can develop into cirrhosis of the liver, or liver wrinkles and liver cancer, is a poor cost.
+Mood Kutsar, an epidemiology adviser at the Department of Health, says acute hepatitis is the same for all types of liver inflammation - fever, fatigue, appetite, nasalty, vomiting, abdominal pain, sneeze, dark urine, muscle and joint pain, and the yellowness of the skin and mucus.
+The popular name for liver inflammation also comes from the latest disease.
+In children, hepatitis can progress without signs of disease.
+Different types of inflammation can only be determined on the basis of data from laboratory studies.
+Extreme hepatitis can switch to chronic hepatitis and run for decades without signs of disease, meaning a person may not know anything about their dangerous liver-damaging disease.
+Mr Kutsar points out different forms of hepatitis and describes their progress more closely.
+Hepatitis A viruses spread from sick people and infect us by eating contaminated food or drinking water, through sex, from the stools of an infected person to their hands and hands to their hands, surfaces, objects, mouths and drug use.
+Family members and carers of hepatitis infection, people with chronic liver disease, people having sex with infected people, men having sex with men, drug addicts, travelers visiting countries with hepatitis A high spread.
+Infectiousness can be prevented by vaccination, in particular for people travelling at risk of vaccination and at risk of hepatitis A.
+In addition, daily hygiene compliance is important: wash or disinfect your hands, wash all fruit and vegetables before using them for food.
+Hepatitis B viruses are spread when exposed to the blood of a sick person, injecting drugs, tattooing, hole-in-aged, blood-contaminated creatures (toothbrushes, squatting tools), donor blood, having sex with a hepatitis-chemist, hepatitis Cathedential person, and from a hepatitis-stricken mother to the foelicen/born.
+The risk group for hepatitis B infection includes injection drug addicts, sex partners of an infected person, men having sex with men, newborns of an infected mother, sick family members and carers, health, rescue workers and police officers exposed to blood and other bodily fluids, and travelers visiting countries with high hepatitis B.
+People can be vaccinated to prevent hepatitis B; in particular, people at risk have been recommended, as well as those with chronic liver disease, HIV infection, sexually transmitted diseases and diabetes.
+Other preventive measures for hepatitis B include: avoiding the use of foreign hygiene and manicure products, other sharpeners and needles, tattooing and hole-in-the-wall, and the use of condoms in the event of infectious sex or avoiding sexual risky behaviour.
+Vaccination against hepatitis B is part of the national immunisation scheme in Estonia and free for children.
+Hepatitis C viruses are spread when exposed to the blood of a sick person, injecting drugs, tattooing, skull, using blood-contaminated creatures, donor blood, having sex with a hepatitis-maker, and from hepatitis to mother to foetus/best.
+The risk group for hepatitis C infection includes injection drug addicts, sex partners of an infected person, men having sex with men, newborns of an infected mother, sick family members and carers, health, rescue workers and police officers exposed to blood and other bodily fluids, HIV infections, and travelers visiting countries with high hepatitis C.
+The prevention measure of hepatitis C is: avoiding the use of foreign hygiene and manicure products, other sharpeners and syringes and needles, tattooing and sniffing, and using condoms for condom-threatening sex.
+There is no vaccine against hepatitis C.
+Hepatitis D is caused by hepatitis D virus, which reproduces in the presence of hepatitis B virus.
+As a result, hepatitis D infection occurs in hepatitis B or as a super infection in chronic hepatitis B patients.
+Hepatitis D viruses are spread through contact with blood and other bodily fluids, with contaminated needles, sexually and rarely infected mothers to the fetus.
+Hepatitis D is a risk group for chronic hepatitis B virus carriers and people with no immunity against hepatitis B.
+An effective preventive measure is vaccination with the hepatitis B vaccine, which also protects people from infection with the hepatitis D virus.
+Hepatitis viruses spread through fetal-oral drinking water and food, including eating low-heated beef, fish and sea cucumbers, donor blood, joint-use syringes and infected mothers to fetus.
+Passengers may become infected in countries with hepatitis E high disease.
+Hepatitis prevention measures include meeting hygiene requirements: wash or disinfect your hands after going to the toilet, before cooking and eating, after caring for the sick.
+Wash fruit and vegetables before consumption, avoid eating low-heated beef, fish and seafood, drink only safe drinking water and avoid drug use.
+While rivals tried to sprint off the four-time Olympic champion in the final round, 34-year-old Farah found strength in the final round and won in 26.49.51.
+Farah didn't think long, pulling his wife Tania and children along the way with him after the finish.
+It was a special moment for me.
+I very much miss my family.
+Being on the track with them was wonderful," Farah told reporters.
+Farah is aiming for a fifth title race in London in a row with a golden duo of 5,000 and 10,000 metres.
+Anything is possible if you believe in it.
+Despite the title, Anne-Marie O'Connor's "Daam in Gold; Gustav Klimt's masterpiece, Adele Bloch-Bauer's Portrait Extraoral Story," delves much deeper into the origin story of one artwork from the birth story of one artwork to the cultural life of late 19th and early 20th-century Vienna.
+But even more in history.
+The awesome amount of information would perhaps have been worn out, perhaps a louder cut, a narrower subject that allowed the portrait allowed in the title to become more of an impact.
+Today, there would be two books on the same cover: the story of Gustav Klimt and his painting "Daam in Gold," Adele Bloch-Bauer, and a much larger and more comprehensive historical book about the esteemed Jewish families and the German occupation, along with its aftermath in Austria.
+The first third of the book leads to the cultural life of Vienna in the midst of a bustling Vienna, and who have entered the Austrian capital, you can imagine, without the slightest effort, how life went around Ringstrasse more than a hundred years ago, or how everyone turned their heads in the Central Cafe when Klimt stepped in.
+The concentration of cultural figures was high in one of Europe's richest cities, and when you see a familiar name in the book, you feel more cultured.
+At the same time, for example, the fact that Sigmund Freud operated in a city where incurable syphilis was rampant and was Europe's highest suicide rate, doesn't seem to add anything to the story's development.
+Or, perhaps, every pair of brushstrokes adds colours to the cultural life of the early 20th century in Vienna.
+The dream of a trip to the Soviet Union
+In the last decades of the 19th century, the number of Jews in Vienna had exploded, becoming the largest Jewish community in Western Europe.
+At the turn of the century, almost one in ten residents of Vienna was a Jew.
+Adele's parents were newcomers to Vienna, too, but by the time Adele married her two-time Open Czech sugar magnate Ferdinand Bloch and Klimt for her famous paintings, her father's bank had become the seventh-largest bank in the Habsburg empire.
+But Adelet didn't draw all the glamorous life to which she belonged.
+If you look at "Damid in gold," it's hard to believe that towards the end of her life, this great lady became infected with socialism and dreamed of a trip to the Soviet Union.
diff --git a/tests/decoder/intgemm/intgemm_16bit.avx512.expected.bleu b/tests/decoder/intgemm/intgemm_16bit.avx512.expected.bleu
new file mode 100644
index 0000000..ea68583
--- /dev/null
+++ b/tests/decoder/intgemm/intgemm_16bit.avx512.expected.bleu
@@ -0,0 +1 @@
+BLEU+case.mixed+numrefs.1+smooth.exp+tok.13a+version.1.2.12 = 30.4 66.3/38.6/24.4/15.7 (BP = 0.967 ratio = 0.967 hyp_len = 2745 ref_len = 2838)
diff --git a/tests/decoder/intgemm/intgemm_8bit.avx.expected b/tests/decoder/intgemm/intgemm_8bit.avx.expected
new file mode 100644
index 0000000..86d329f
--- /dev/null
+++ b/tests/decoder/intgemm/intgemm_8bit.avx.expected
@@ -0,0 +1,100 @@
+Four members of the Kemerovo group detained in Estonia and Spain
+Slava Gulevich, the leader of the so-called Kemerovo group in Spain and is known in the criminal world as Slava Kemerovsky, was detained by police in Spain, according to the Post.
+Gulevich, who was detained in Spain, was arrested with court permission.
+Yesterday, the court also took custody of three suspects detained in Estonia.
+The suspect is said to be members of the so-called Kemerovo Crime Society between the ages of 27 and 57, who mainly commit drug offences.
+The alleged leader of a criminal association has been detained in Mija, Malaga province, Spain.
+Three men were arrested on suspicion of suspects in Estonia, one of whom is a leading figure in the criminal association and two are members of the criminal association, according to the data collected.
+The data collected indicate that the roles and roles were clearly distributed in the criminal community.
+The purpose of the criminal association's activities was to commit drug crimes and thus generate criminal proceeds," said Vaur Verte, head of pre-trial proceedings in the criminal case.
+"We are not ruling out increasing the number of suspects in this criminal case," the prosecutor added.
+These are people who have been in the interest of law enforcement in the past, and some have been punished for drug crimes.
+Verte stressed that cooperation with Spanish counterparts has been important throughout the investigation.
+"International cooperation has become commonplace for us, and this week's operation shows the success of cooperation," said prosecutor Verte.
+Cleveland Police Service chief executive Ago Leis said the arrests were preceded by a year-and-a-half probe.
+"In the first half of the long-running work, we have continued to have suspicions of crimes in Estonia and in Spain," he said.
+The inquest added that federal police officers were assisting in the arrests in Spain.
+For years now, we have had good contact and understanding with the Spanish police and the Civil Guard.
+These arrests are yet another message to criminals that we can get them from the other end of Europe," Leis said.
+The information gathered so far clearly indicates that the men who have been on suspicion of committing new crimes can continue to commit new crimes, which is why the prosecution has requested their arrest and the court approved it.
+A man arrested in Spain is awaiting his surrender to Estonia.
+Property, vehicles and cash have been seized as part of this criminal case to ensure confiscation.
+Pre-trial proceedings in the case are carried out by the Central Criminal Police Organised Crime Bureau and led by the Crown Prosecution Service.
+Slava Gulevich was convicted of extortion by a district court in 2005 and sentenced to five years in prison.
+In the middle of last decade, Gulevich was considered the second most important man in the Estonian criminal world after then-All-world leader Nikolai Tarankov.
+Gulevich, from Kemerovo, rose to prominence in the Estonian underworld in the early 1990s when he began to commit extortion in Tallinn.
+He allegedly taxi drivers and prostitutes operating at various hotels and demanded monthly rookie fees for businessmen.
+International joint operations, confiscations of criminal proceeds and court rulings that have come into force confirm that the fight in the area of organised crime is effective.
+For example, the latest court rulings, eight defendants from the so-called Dikayev Criminal Association criminal case who were ordered to have their criminal proceeds of EUR 80,000, or the judgment of nine individuals in 2006 for Igor Aleynikov, who aimed at the illegal trade of cigarettes and the crimes of human trafficking in East Virginia and the South.
+Confirl-based criminal income there is around EUR 71,500.
+Success in these criminal matters has been ensured by the fact that police officers exchange information and evidence with foreign colleagues every day and, if necessary, carry out actions in any European Union country.
+Civil rights group warns against traveling to Missouri
+The National Association for the Advancement of Colored People (NAACP) has warned black people travelling to Missouri against discriminatory policies and racist attacks in the state.
+The group's statement reads: "A NAACP travel note issued for the state of Midsugar, which runs until 28 August 2017, calls on all African-Americans, visitors and Missouriers to be particularly attentive and extremely careful as they move around the state, taking into account the suspicious racial events that have occurred across the state recently and are being brought out here."
+The NAACP said the group was encouraged to issue travel warnings both in the recent Missouri law making it harder to win discrimination lawsuits and the fact that the state's law enforcement agencies target minorities in an unequal way.
+"People's civil rights are being violated.
+They are pulled to the edge of the road because of the colour of their skin, beaten or killed," Rod Chapel, president of the Missouri branch of the NAACP, told The Kansas City Star.
+'We've never had so close complaints before.'
+This is the first such warning the organization has issued for the U.S. state.
+The group cited events such as racist insults at the University of Missouri and the death of 28-year-old black Tory Sanders, a 28-year-old black man from Tennessee.
+Sanders died in suspicious circumstances earlier this year after he ran out of petrol while driving through the state and was taken into custody by Missouri police without being charged with a crime.
+In addition, the note cites a recent report by the Missouri attorney general that shows that in the state, black motorists are 75% more likely to be stopped than white people.
+"It's meant to make people aware and warn their families, friends and co-workers about what might happen in Missouri," Chapel said.
+"People have to be prepared, whether it's taking bail money or informing relatives that they're going through the state," he said.
+According to the latest data from the FBI's hate crime reporting program, Missouri documented 100 hate crimes in 2015, putting the state 16th in the state's number of similar violations.
+The travel warning is also a response to a new law in Missouri that makes it harder for the company to sue for discrimination in the search for housing or work.
+The American Civil Liberties Union (American Civil Liberties Union) had previously issued travel briefings for Texas and Arizona after those states passed immigration laws that required local authorities to arrest people for immigration violations because the ACLU said it would increase racial profiling.
+Typically, travel warnings are issued by the Department of Foreign Affairs for other countries, but recently interest groups have started using the measure as a counter-reaction to certain laws and trends within the U.S..
+Hepatitis: what would anyone know about the different forms of this serious disease?
+Hepatitis, or liver inflammation, can be caused by five different, A, B, C, D and hepatitis E virus.
+All these viruses trigger acute inflammation of liver tissue.
+However, the negative cost is chronic hepatitis B and C, which can develop into liver cirrhosis, or liver wrinkles and liver cancer.
+Moodow Kutsar, an epidemiology adviser at the Department of Health, says acute hepatitis is the same for all types of liver inflammation - fever, fatigue, plantation, nausea, vomiting, stomach pain, glandular extremities, dark urine, muscular and joint pain, and the collarbone of the skin and mucus.
+The most recent disease also comes from the popular name for liver inflammation, collaboratories.
+In children, hepatitis can go untreated.
+Different types of inflammation can only be determined based on data from laboratory studies.
+Extreme hepatitis can switch to chronic hepatitis and go on for decades without signs of disease, meaning a person may not know anything about their dangerous liver-damaging disease.
+Mr Kutsar points out different forms of hepatitis and describes their progress more closely.
+Hepatitis A viruses spread from sick people and infect us when eating contaminated food or drinking water, through sex, from the stool of an infected person's stool to their arms and from their hands to their arms, surfaces, objects, mouth and taking drugs.
+The risk of hepatitis infection, or at-risk family members and carers, people with chronic liver disease, people having sex with infected people, men having sex with men, drug addicts, travelers visiting countries with hepatitis A high-protein A.
+Infectiousness can be prevented by vaccination, particularly for people travelling and at risk of hepatitis A.
+In addition, daily hygiene requirements are essential: wash or disinfect your hands before using all fruit and vegetables.
+Hepatitis B viruses are spread when they come into contact with the blood of a sick person, injecting drugs, tattooing, hole-in-armed, foxes of blood-soaked creatures (toothbrushes, waste products), donor blood, having sex with a hepatitis sushi personality, and from a hepatitis-death mother to foetal/born.
+The risk group for hepatitis B infection includes injection drug addicts, sex partners of an infected person, men having sex with men, newborns of an infected mother, sick family members and carers, health, rescue workers and police officers exposed to blood and other bodily fluids, and travellers visiting countries with high levels of hepatitis B.
+It is possible to vaccinate people to prevent hepatitis B; in particular, people at risk have been recommended, as well as those with chronic liver disease, HIV infections, sexually transmitted diseases and diabetes.
+Other preventive measures for hepatitis B include: avoiding the use of alien hygiene and manicure, other sharpeners and syringe-infested stints, tattooing and holeing, and using a condom in the event of infection-prone sex or avoiding sexual risk behavior.
+Vaccination against hepatitis B is free of charge for the national immunisation scheme in Estonia and for children.
+Hepatitis C viruses are spread when a sick person's blood is exposed to, injected with drugs, tattooing, hole-in-aged, using blood contaminated with humans, having sex with a hepatitis person, and having hepatitis from mother to foetal/born.
+The risk group for hepatitis C infection includes injecting drug addicts, sextive partners of an infected person, men having sex with men, newborns of an infected mother, sick family members and carers, health workers and police officers exposed to blood and other bodily fluids, and travelers visiting countries with hepatitis C.
+The prevention measure for hepatitis C is: avoiding the use of foreign hygiene and manicure, other sharpeners and syringe-infections, tattooing and holeing, and using condoms for infectious sex.
+There is no vaccine against hepatitis C.
+Hepatitis D is caused by hepatitis D virus, which reproduces in the presence of hepatitis B virus.
+As a result, hepatitis D infection occurs in combination with hepatitis B or a superficial infection in chronic hepatitis B patients.
+Hepatitis D viruses are spread through exposure to blood and other bodily fluids, with contaminated needles, sexually transmitted and from a rarely infected mother to the foetus.
+The risk group for hepatitis D is chronic hepatitis B virus carriers and people who do not have immunity against hepatitis B.
+An effective preventive measure is vaccination with the hepatitis B vaccine, which also protects people from infection with the hepatitis D virus.
+Hepatitis viruses spread fetal-oral teaspoon with drinking water and food, including eating low-heated beef, fish and sea cucumbers, donor blood, commonly used syringes and infected mother to foetuses.
+Passengers can become infected in countries with hepatitis E high disease.
+Preventive measures for hepatitis are hygiene requirements: wash or disinfect your hands after going to the toilet, before cooking and eating, after caring for the sick.
+Beat fruit and vegetables before consumption, avoid eating low-profile beef, fish and seafood, drink only safe drinking water and avoid drug use.
+While rivals tried to sprint off the four-time Olympic champion in the final round, 34-year-old Farah found strength in the final round and won in a time of 26.49.51.
+Farah didn't think long, pulling his wife Tania and the children along with him after the finish.
+It was a special moment for me.
+I very much miss my family.
+Being on the track with them was wonderful," Farah told reporters.
+Farah is aiming for a golden duo of the 5,000 and 10,000 meters race in London for his fifth title race in a row.
+Anything is possible if you believe in it.
+Despite the title, Anne-Marie O'Connor's "Daam in Gold; Gustav Klimt's masterpiece, the extraordinary story of Adele Bloch-Bauer's portrait" delves much deeper into the origin story of one artwork from the birth story of the late 19th and early 20th-century Vienna of the early 19th and early 20th-century Vienna.
+But even more in history.
+The awesome amount of information might have worn off a louder cut, a narrower subject that allowed the portrait allowed in the title to become more of an influence.
+There would be two books now in one of the covers: the story of Adele Bloch-Bauer, depicted in her painting "Daam in Gold," and a much larger and comprehensive historical record of the esteemed Jewish families and the German occupation, along with its after-effects in Austria.
+The first third of the book leads to the cultural life of Vienna in the midst of a bustling Vienna, and whoever has themselves entered the Austrian capital can imagine, without the slight effort, how life went around Ringstrasse more than 100 years ago, or how everyone turned their heads around the Central Cafe when Klimt stepped in.
+The concentration of cultural figures was high in one of Europe's richest cities, and when you see the familiar name in the book, you feel more cultured.
+At the same time, for example, the fact that Sigmund Freud operated in a city where incurable syphilis was rampant and was Europe's highest suicide rate does nothing more about the development of the story.
+Or perhaps, anyway, each pair of brushstrokes adds colours to the cultural life of the early 20th century in Vienna.
+dream of a trip to the Soviet Union
+In the last decades of the 19th century, the number of Jews in Vienna had exploded, becoming the largest Jewish community in Western Europe.
+At the turn of the century, nearly one in ten of Vienna's residents were Jews.
+Adele's parents were also newcomers to Vienna, but by the time Adele married herself twice to open a Czech sugar magnate, Ferdinand Bloch, and Klimt was posing for her famous paintings, her father's bank had become the seventh largest bank in the Habsburg empire.
+But Adelet didn't draw all the glamorous life to which she belonged.
+If you look at "Dama in gold," it's hard to believe that, towards the end of her life, this great lady became infected with socialism and dreamed of a trip to the Soviet Union.
diff --git a/tests/decoder/intgemm/intgemm_8bit.avx.expected.bleu b/tests/decoder/intgemm/intgemm_8bit.avx.expected.bleu
new file mode 100644
index 0000000..eee67e5
--- /dev/null
+++ b/tests/decoder/intgemm/intgemm_8bit.avx.expected.bleu
@@ -0,0 +1 @@
+BLEU+case.mixed+numrefs.1+smooth.exp+tok.13a+version.1.2.12 = 30.3 65.7/38.2/24.5/15.8 (BP = 0.966 ratio = 0.966 hyp_len = 2742 ref_len = 2838)
diff --git a/tests/decoder/intgemm/intgemm_8bit.avx2.expected b/tests/decoder/intgemm/intgemm_8bit.avx2.expected
new file mode 100644
index 0000000..c27d439
--- /dev/null
+++ b/tests/decoder/intgemm/intgemm_8bit.avx2.expected
@@ -0,0 +1,100 @@
+Four members of the Kemerovo group detained in Estonia and Spain
+According to the Post, police detained Slava Gulevich, the leader of the so-called Kemerovo group in Spain, known in the criminal world as Slava Kemerovsky.
+Gulevich, who was detained in Spain, was arrested with court permission.
+Yesterday, the court also took three suspects detained in Estonia into custody.
+The suspect is said to be members of the so-called Kemerovo Crime Society between the ages of 27 and 57, who are mainly responsible for drug offences.
+The alleged leader of a criminal association has been detained in Mija, Malaga province, Spain.
+Three men were arrested on suspicion of being arrested in Estonia, one of whom is a leading figure in the criminal association and two are members of the criminal association, according to the data collected.
+The data collected indicate that the roles and roles were clearly divided in the criminal community.
+The purpose of the criminal association's activities was to commit drug offences and thus generate criminal proceeds," said Mr Verte, the head of pre-trial proceedings in the criminal case.
+"We are not ruling out that the number of suspects in this criminal case will increase," the prosecutor added.
+These are people who have been in the interest of law enforcement in the past, and some have been punished for drug offences.
+Verte stressed that cooperation with its Spanish counterparts had been important throughout the investigation.
+"International cooperation has become commonplace for us, and this week's operation shows the success of cooperation," said prosecutor Verte.
+Ago Leis, head of the Metropolitan Police Service, said the arrests followed a year-and-a-half probe.
+"In the first half of the year, the long-running work materialised and we detained suspects of crimes in Estonia and Spain at the same time," he said.
+Leis added that Central Criminal Police officers were assisting in the arrest in Spain.
+For years now, we have had good contact and understanding with the Spanish police and the Civil Guard.
+These arrests are another message to criminals that we can get them from the other end of Europe," Leis said.
+The information gathered so far clearly indicates that the men who have been charged may continue to commit new crimes while at large, which is why the prosecution requested their arrest and the court approved it.
+A man arrested in Spain is awaiting transfer to Estonia.
+Property, vehicles and cash have been seized as part of this criminal case to ensure confiscation.
+The pre-trial proceedings in the case are carried out by the Central Criminal Police Organised Crime Bureau and led by the Crown Prosecution Service.
+Slava Gulevich was convicted of extortion and sentenced to five years in prison in 2005.
+In the middle of last decade, Gulevich was considered the second most important man in the Estonian criminal world after Nikolai Tarankov, then an underworld leader.
+Gulevich, from Kemerovo, rose to prominence in the Estonian underworld in the early 1990s when he began to deal with extortion in Tallinn.
+He allegedly taxiderned taxi drivers and prostitutes operating at various hotels and charged businessmen with monthly rookie fees.
+International joint operations, confiscations of criminal proceeds and court rulings that have come to lighten up confirm that the fight against organised crime is effective.
+For example, the latest court rulings, eight defendants separated from the so-called Dikayev Criminal Association criminal case, who were ordered to pay the proceeds of BGN 80,000, or the judgment of nine individuals in 2006 for Igor Aleynikov to set up a criminal association aimed at the illegal trade of cigarettes and the crimes of human trafficking in East Virginia and the South in Estonia.
+Confidential criminal income there is around EUR 71,500.
+In these criminal matters, it has ensured that police officers exchange information and evidence with foreign colleagues every day and, if necessary, carry out actions in any European Union country together.
+Civil rights group warns against travel to Missouri
+The National Association for the Advancement of Colored People (NAACP) has warned black people travelling to Missouri against discriminatory policies and racist attacks in the state.
+The group's statement reads: "An NAACP travel note issued for the state of Mussour, which runs until August 28, 2017, calls on all African-Americans, visitors and Missourians to be particularly attentive and extremely careful as they move around the state, taking into account the suspicious racial events that have occurred recently across the state and are also brought out."
+The NAACP said the group urged both the recent Missouri law to issue a travel warning, making it harder to win discrimination lawsuits and the fact that the state's law enforcement officers target minorities are disproportionately largely targeted.
+"People's civil rights are violated.
+They are pulled onto the side of the road because of the color of their skin, beaten or killed," Rod Chapel, president of the Missouri branch of the NAACP, told The Kansas City Star.
+'We've never had so close complaints before.'
+It is the first such warning the organization has issued about the U.S. state.
+The group cited events such as racist insults at the University of Missouri and the death of a 28-year-old black Tory Sanders from Tennessee.
+Sanders died in suspicious circumstances earlier this year after he ran out of petrol while driving through the state and was taken into custody by police in Missouri without being charged with a crime.
+In addition, the note points to a recent report by the Missouri Attorney General, which shows that in the state, black drivers are 75% more likely to stop cars than those of whites.
+"It's about making people aware and warning their families, friends and co-workers about what might happen in Missouri," Chapel said.
+"People have to be prepared, whether it's going to take bail money or to inform relatives that they're going through the state," he said.
+According to the latest data from the FBI's hate crime reporting program, Missouri documented 100 hate crimes in 2015, putting the state 16th in the state in terms of similar violations.
+The travel warning is also a response to a new law in Missouri that makes it harder for the company to sue for discrimination in search of housing or work.
+The American Civil Liberties Union (American Civil Liberties Union) had previously issued travel updates on Texas and Arizona after those states passed immigration laws that required local authorities to arrest people for immigration violations because the ACLU said it would increase racial profiling.
+Typically, travel warnings are issued by the Foreign Office for other countries, but recently interest groups have started using the measure as a counter-reaction to certain laws and trends in the U.S..
+Hepatitis: what would anyone know about the different forms of this serious disease?
+Hepatitis, or liver inflammation, can be caused by five different - A, B, C, D and E virus.
+All these viruses trigger acute inflammation of liver tissue.
+However, at a bad cost, chronic hepatitis B and C can develop into liver cirrhosis, or liver wrinkles and liver cancer.
+Mooth Vito Kutsar, an epidemiology adviser to the NHS, says acute hepatitis is the same for all types of liver inflammation - fever, fatigue, planting, nausea, vomiting, stomach pain, glowing urine, muscular and joint pain and the yellowing of the skin and mucus.
+The most recent disease also comes from the popular name for liver inflammation.
+In children, hepatitis can go without signs of disease.
+Different types of inflammation can only be identified from the data from the laboratory study.
+Extreme hepatitis can transition into chronic hepatitis and run for decades without signs of illness, meaning a person may not know anything about their dangerous liver-damaging disease.
+Mr Kutsar points out different forms of hepatitis and describes their progress more closely.
+Hepatitis A viruses spread from sick people and infect us when eating contaminated food or drinking water, through sex, from the stools of an infected person to their hands and arms from their arms to their arms, surfaces, objects, mouths and drug use.
+Family members and carers of hepatitis infection, known as risk-averse disease, people with chronic liver disease, people having sex with infected men, drug addicts, passengers visiting countries with hepatitis A high spread.
+Infectiousness can be prevented by vaccination, in particular for people travelling at risk of vaccination and in a hepatitis A risk group.
+In addition, daily hygiene requirements are essential: wash or disinfect your hands before using all fruit and vegetables.
+Hepatitis B viruses are spread when exposed to the blood of a sick person, injecting drugs, tattooing, hole-in-dural, using blood-soaked creatures (toothbrushes, squatting tools), donor blood, having sex with a hepatitis-deaf person, and having hepatitis from a mother to foetus/born.
+The injection drug addicts, sex partners of an infected person, men having sex with men, newborns of an infected mother, sick family members and carers, health care workers and police officers exposed to blood and other bodily fluids, and travelers visiting countries with high levels of hepatitis B.
+People can be vaccinated to prevent hepatitis B; in particular, people at risk have been recommended, as well as those with chronic liver disease, HIV infection, sexually transmitted diseases and diabetes.
+Other preventive measures for hepatitis B include: avoiding the use of alien hygiene and manicure, other sharpeners and syringes, tattooing and holeing, and using a condom in the event of an infectious sex or avoiding sexual risk behavior.
+Vaccination against hepatitis B is free of charge for children in Estonia as part of the national immunisation scheme.
+Hepatitis C viruses are spread when exposed to the blood of a sick person, injecting drugs, tattooing, hole-in-cheek, using blood contaminated with creatures, donor blood, having sex with a hepatitis-related person, and from hepatitis to mother to foetus/born.
+The risk of hepatitis C infection includes injection drug addicts, sex partners of an infected person, men having sex with men, newborns of an infected mother, sick family members and carers, health care workers and police officers exposed to blood and other bodily fluids, people with HIV infection, and travelers visiting countries with high hepatitis C disease.
+The prevention measure for hepatitis C is: avoiding the use of alien hygiene and manicure, other sharpeners and syringe-indulgence, tattooing and sniffing, and the use of condoms in the event of infection-prone sex.
+There is no vaccine against hepatitis C.
+Hepatitis D is caused by a hepatitis D virus that reproduces in the presence of the hepatitis B virus.
+As a result, hepatitis D infection occurs in hepatitis B or a super infection in chronic hepatitis B patients.
+Hepatitis D viruses are spread through exposure to blood and other bodily fluids, with contaminated needles, sexually transmitted and from the rarely infected mother to the foetus.
+The risk group for hepatitis D is chronic hepatitis B virus carriers and people who do not have immunity against hepatitis B.
+An effective preventive measure is vaccination with the hepatitis B vaccine, which also protects people from infection with the hepatitis D virus.
+Hepatitis viruses spread fetal-oral tea with drinking water and food, including eating low-heated beef, fish and sea cucumbers, donor blood, commonly used syringes and infected mother to foetus.
+Passengers can become infected in countries with hepatitis E at high rates of disease.
+Hepatitis prevention measures include meeting hygiene requirements: wash or disinfect your hands after going to the toilet, before cooking and eating, after caring for the sick.
+Washing fruit and vegetables before consumption, avoid eating low-heated beef, fish and seafood, drink only safe drinking water and avoid drug use.
+While rivals tried to sprint off the four-time Olympic champion in the final round, the 34-year-old Farah found strength in the final round and won in 26.49.51.
+Farah didn't think long, pulling his wife Tania and the children along with him after the finish.
+It was a special moment for me.
+I greatly miss my family.
+Being on the track with them was wonderful," Farah told reporters.
+Farah is aiming for a fifth title race in a row in London with a 5,000 and 10,000-metre run.
+Anything is possible if you believe in it.
+Despite the title, Anne-Marie O'Connor's "Daam in Gold; Gustav Klimt's masterpiece, the extraordinary story of the extraordinary story of Adele Bloch-Bauer's portrait" delves much deeper into the origin story of one of the artworks of the late 19th and early 20th-century Vienna cultural life.
+But even more in history.
+The awesome amount of information might have worn off a louder cut, a narrower subject that allowed the portrait allowed in the title to become more of an influence.
+There would be two books in one of the covers: the story of Adele Bloch-Bauer, depicted in her painting "Daam in Gold," and a much larger and comprehensive historical record of respectable Jewish families and the German occupation, along with its after-effects in Austria.
+The first third of the book leads to the cultural life of Vienna in the midst of a bustling Vienna, and whoever has themselves in the Austrian capital can imagine how life went around Ringstrasse more than 100 years ago, or how everyone turned their heads in the Central Cafe when Klimt stepped in.
+The concentration of cultural figures was high in one of Europe's richest cities, and when you see the familiar name in the book, you feel like a more grammar.
+At the same time, for example, the fact that Sigmund Freud was operating in a city where incurable syphilis was rampant and had the highest suicide rate in Europe is not going to add anything to the development of the story.
+Or perhaps, every pair of brushstrokes adds colour to the cultural life of the early 20th century in Vienna.
+A dream of a trip to the Soviet Union
+In the last decades of the 19th century, the number of Jews in Vienna had exploded, becoming the largest Jewish community in Western Europe.
+At the turn of the century, almost one in ten of Vienna's residents were Jews.
+Adele's parents were also newcomers to Vienna, but by the time Adele married herself twice to open a Czech sugar magnate, Ferdinand Bloch, and Klimt was posing for her famous paintings, her father's bank had already become the seventh largest bank in the Habsburg empire.
+But Adelet didn't draw all the glamorous life to which she was a part.
+Looking at "Damid in gold," it's hard to believe that, towards the end of his life, this great lady became infected with socialism and dreamed of a trip to the Soviet Union.
diff --git a/tests/decoder/intgemm/intgemm_8bit.avx2.expected.bleu b/tests/decoder/intgemm/intgemm_8bit.avx2.expected.bleu
new file mode 100644
index 0000000..62f2834
--- /dev/null
+++ b/tests/decoder/intgemm/intgemm_8bit.avx2.expected.bleu
@@ -0,0 +1 @@
+BLEU+case.mixed+numrefs.1+smooth.exp+tok.13a+version.1.2.12 = 29.7 65.8/37.8/23.9/15.3 (BP = 0.962 ratio = 0.963 hyp_len = 2733 ref_len = 2838)
diff --git a/tests/decoder/intgemm/intgemm_8bit.avx512.expected b/tests/decoder/intgemm/intgemm_8bit.avx512.expected
new file mode 100644
index 0000000..616d0aa
--- /dev/null
+++ b/tests/decoder/intgemm/intgemm_8bit.avx512.expected
@@ -0,0 +1,100 @@
+Four members of the Kemerovo group detained in Estonia and Spain
+Slava Gulevich, the leader of the so-called Kemerovo group in the Estonian underworld and is known in the criminal world as Slava Kemerovsky, was detained by police in Spain, according to the Post.
+Gulevich, who was detained in Spain, was arrested with court permission.
+Yesterday, the court also took three suspects detained in Estonia into custody.
+The suspect is said to be members of the so-called Kemerovo Crime Society between the ages of 27 and 57, who are mainly involved in drug offences.
+The alleged leader of a criminal association has been detained in Mijas, Malaga province, Spain.
+Three men were arrested on suspicion of being arrested in Estonia, one of whom is a leading figure in the criminal association and two are members of the criminal association, according to the data collected.
+The data collected indicate that the roles and roles were clearly divided in the criminal community.
+The purpose of the criminal association's activities was to commit drug offences and thus generate criminal proceeds," said Mr Verte, head of pre-trial proceedings in the criminal case.
+"We are not ruling out that the number of suspects in this case will increase," the prosecutor added.
+These are people who have been in the interest of law enforcement in the past, and some have been punished for drug offences.
+Verte stressed that cooperation with its Spanish counterparts has been important throughout the investigation.
+"International cooperation has become commonplace for us, and this week's operation shows the success of cooperation," said prosecutor Verte.
+Ago Leis, head of the Central Criminal Police Service, said the arrests were preceded by a year-and-a-half-long preliminary investigation.
+"In the first half of the year, the long-running work materialised and we detained suspects of crimes in Estonia and Spain at the same time," he said.
+Leis added that officers from the Central Criminal Police were assisting in the arrest in Spain.
+For years now, we have had good contact and understanding with the Spanish police and the Civil Guard.
+These arrests are another message to criminals that we can get them from the other end of Europe," Leis said.
+The information gathered so far clearly indicates that the men suspected of continuing to commit new crimes while at large, which is why the prosecution requested their arrest and the court approved it.
+A man arrested in Spain is awaiting transfer to Estonia.
+Property, vehicles and cash have been seized as part of this criminal case to ensure confiscation.
+The pre-trial proceedings in the case are carried out by the Central Criminal Police Organised Crime Bureau and led by the Crown Prosecution Service.
+Slava Gulevich was convicted of extortion and sentenced to five years in prison in 2005.
+In the middle of last decade, Gulevich was considered the second most important man in the Estonian criminal world after Nikolai Tarankov, then the underworld leader.
+Gulevich, from Kemerovo, rose to prominence in the Estonian underworld in the early 1990s when he began to engage in extortion in Tallinn.
+He allegedly taxided taxi drivers and prostitutes operating at various hotels and charged businessmen with monthly rookie fees.
+International joint operations, confiscations of criminal proceeds and court rulings that have come into force confirm that the fight against organised crime is effective.
+For example, the latest court rulings, eight defendants separated from the so-called Dikayev Criminal Association criminal case who were ordered to receive a criminal offence of EUR 80,000, or the judgment of nine individuals in 2006 for Igor Aleynikov, who aimed at the illegal trade of cigarettes and the crimes of human trafficking in East Virginia and the South in Estonia, in 2006.
+Confidential criminal proceeds there are around EUR 71,500.
+In these criminal matters, it has ensured that police officers exchange information and evidence with foreign colleagues every day and, if necessary, carry out actions in any country of the European Union.
+Civil rights group warns against travel to Missouri
+The National Association for the Advancement of Colored People (NAACP) has warned black people travelling to Missouri against discriminatory policies and racist attacks in the state.
+The group's statement reads: "An NAACP travel note issued for the state of Mussuri, which runs until August 28, 2017, calls on all African-Americans, visitors and Missouriers to be particularly vigilant and extremely careful as they move around the state, taking into account the suspicious racially-based events that have occurred recently across the state."
+The NAACP said the group urged the travel warning to issue both the recent Missouri law, making it harder to win antitrust lawsuits and the fact that the state's law enforcement agencies target minorities in an unequal way.
+"People's civil rights are violated.
+They are pulled to the side of the road because of the colour of their skin, beaten or killed," Rod Chapel, president of the Missouri branch of the NAACP, told The Kansas City Star.
+'We've never had so close complaints before.'
+It is the first such warning the organization has issued about the U.S. state.
+The group cited events such as racist insults at the University of Missouri and the death of a 28-year-old black Tory Sanders from Tennessee.
+Sanders died in suspicious circumstances earlier this year after he ran out of petrol while driving through the state and was taken into custody by Missouri police without being charged with a crime.
+In addition, the comment cites a recent report by the Missouri attorney general that shows that in the state, black drivers are 75% more likely to stop cars than white people.
+"It's about making people aware and warning their families, friends and co-workers about what might happen in Missouri," Chapel said.
+"People have to be prepared, whether it means taking bail money or informing relatives that they are going through the state," he said.
+According to the latest data from the FBI's hate crime reporting program, Missouri documented 100 hate crimes in 2015, putting the state 16th in the state's list of similar violations.
+The travel warning is also a response to a new law in Missouri that makes it harder for the company to sue for discrimination in search of housing or work.
+The American Civil Liberties Union (American Civil Liberties Union) had previously issued travel updates on Texas and Arizona after those states passed immigration laws that required local authorities to arrest people for immigration violations, which said it would increase racial profiling.
+Typically, travel warnings are issued by the Foreign Office for other countries, but recently interest groups have started using the measure as a countervisor to certain laws and trends in the U.S..
+Hepatitis: what would anyone know about different forms of this serious disease?
+Hepatitis, or liver inflammation, can be caused by five different - A, B, C, D and E virus.
+All these viruses trigger acute inflammation of liver tissue.
+However, chronic hepatitis B and C has chronic hepatitis, which can develop into liver cirrhosis, or liver wrinkles and liver cancer.
+Moodow Kutsar, an epidemiology adviser at the Department of Health, says acute hepatitis is the same for all types of liver inflammation - fever, fatigue, appetite, nausea, vomiting, stomach pain, glandular excitement, dark urine, muscular and joint pain, and the yellowness of the skin and mucus.
+The most recent disease also comes from the popular name for liver inflammation.
+In children, hepatitis can go without signs of disease.
+Various types of inflammation can only be identified from the data from the laboratory study.
+Extreme hepatitis can transition into chronic hepatitis and go on for decades without signs of illness, meaning a person may not know anything about their dangerous liver-damaging disease.
+Mr Kutsar points out different forms of hepatitis and describes their progress more closely.
+Hepatitis A viruses spread from sick people and infect us by eating contaminated food or drinking water, through sex, from the stools of an infected person to their hands and hands to their arms, surfaces, objects, mouths and drug use.
+Family members and carers of hepatitis infection, known as risk-taking groups, people with chronic liver disease, people having sex with infected men, drug users, travelers visiting countries with hepatitis A high-poverty.
+Infectiousness can be prevented by vaccination, in particular for people travelling at risk of vaccination and in a hepatitis A risk group.
+In addition, daily hygiene requirements are essential: wash or disinfect your hands before using all fruit and vegetables.
+Hepatitis B viruses are spread when exposed to the blood of a sick person, injecting drugs, tattooing, hole-in-cheek, blood-soaked creatures (toothbrushes, waste products), donor blood, having sex with hepatitis a person, and having hepatitis from a mother to foetus/born.
+The injection drug addicts, sex partners of an infected person, men having sex with men, the newborns of an infected mother, sick family members and carers, health care workers and police officers who come into contact with blood and other bodily fluids, and travelers visiting countries with hepatitis B.
+People can be vaccinated to prevent hepatitis B; in particular, people at risk have been recommended, as well as those with chronic liver disease, HIV infection, sexually transmitted diseases and diabetes.
+Other preventive measures for hepatitis B include: avoiding the use of foreign hygiene and manicure, other sharpeners and syringes, tattooing and holeing, and the use of condoms in cases of intestinal sex or avoiding sexual risk behavior.
+Vaccination against hepatitis B is free of charge for children in Estonia as part of the national immunisation scheme and for children.
+Hepatitis C viruses are spread when exposed to the blood of a sick person, injecting drugs, tattooing, holed up, using blood contaminated with livers, having sex with hepatitis, having sex with a hepatitis-deaf person, and from hepatitis to mother to foetus/nonnavigation.
+The risk of hepatitis C infection includes injection drug addicts, sextives of an infected person, men having sex with men, newborns of an infected mother, sick family members and carers, health, rescue workers and police officers exposed to blood and other bodily fluids, HIV-infected individuals, and travelers visiting countries with hepatitis C high disease.
+The prevention measure for hepatitis C is: avoiding the use of alien hygiene and manicure, other sharpeners and syringe-indulging, and using condoms for infectious sex.
+There is no vaccine against hepatitis.
+Hepatitis D is caused by a hepatitis D virus that reproduces in the presence of hepatitis B virus.
+As a result, hepatitis D infection occurs in hepatitis B or a super infection in chronic hepatitis B patients.
+Hepatitis D viruses are spread through exposure to blood and other bodily fluids, with contaminated needles, sexually transmitted and from the rarely infected mother to the foetus.
+The risk group for hepatitis D is chronic hepatitis B virus carriers and people who do not have immunity against hepatitis B.
+An effective preventive measure is vaccination with the hepatitis B vaccine, which also protects people from infection with the hepatitis D virus.
+Hepatitis viruses spread fetal-oral tea with drinking water and food, including eating low-heated beef, fish and sea cucumbers, donor blood, commonly used syringes and infected mother to foetus.
+Passengers can become infected in countries with hepatitis E high disease.
+Hepatitis prevention measures include meeting hygiene requirements: wash or disinfect your hands after going to the toilet, before cooking and eating, after caring for the sick.
+Washing fruit and vegetables before consumption, avoid eating low-heated beef, fish and seafood, drink only safe drinking water and avoid drug use.
+While rivals tried to get the four-time Olympic champion off course in the final round, 34-year-old Farah found strength in the final round and won in 26.49.51.
+Farah didn't think long, pulling his wife Tania and the children along with her after the finish.
+It was a special moment for me.
+I greatly miss my family.
+Being on the track with them was wonderful," Farah told reporters.
+Farah is aiming for a fifth title race in a row in London with a 5,000 and 10,000-metre run golden duo.
+Anything is possible if you believe in it.
+Despite the title, Anne-Marie O'Connor's "Daam in gold. Gustav Klimt's masterpiece, the extraordinary story of Adele Bloch-Bauer's portrait" delves much deeper into the origin story of one artwork from the birth story of the late 19th and early 20th-century Vienna.
+But even more in history.
+The awesome amount of information might have worn off, a louder cut, a narrower subject that allowed the portrait allowed in the title to become more of an influence.
+There would be two books on the same cover now: the story of Gustav Klimt and his painting "Daam in Gold," Adele Bloch-Bauer, and a far larger and comprehensive historical record of respectable Jewish families and the German occupation, along with its after-effects in Austria.
+The first third of the book leads to the scorched Vienna cultural life in the midst of the bustling Vienna, and who have themselves in the Austrian capital, one can imagine how life went around Ringstrasse more than a hundred years ago, or how everyone in Central Cafe turned when Klimt stepped in.
+The concentration of cultural figures was high in one of Europe's richest cities, and when you see the familiar name in the book, you feel like a more grammar.
+At the same time, for example, the fact that Sigmund Freud operated in a city where he was subjected to incurable syphilis and was the highest suicide rate in Europe seems to give nothing to the development of the story.
+Or perhaps, every pair of brushstrokes add colour to the cultural life of the early 20th century in Vienna.
+A dream of a trip to the Soviet Union
+In the last decades of the 19th century, the number of Jews in Vienna had exploded, becoming the largest Jewish community in Western Europe.
+At the turn of the century, nearly one in ten of Vienna's residents was a Jew.
+Adele's parents were also newcomers to Vienna, but by the time Adele married her two-time open-minded Ferdinand Bloch, a Czech sugar magnate and Klimt, for her famous paintings, her father's bank had already become the seventh largest bank in the Habsburg empire.
+But Adelet didn't pull on all the glamorous life she was a part of.
+Looking at "Damid in gold," it's hard to believe that, towards the end of his life, this great lady became infected with socialism and dreamed of a trip to the Soviet Union.
diff --git a/tests/decoder/intgemm/intgemm_8bit.avx512.expected.bleu b/tests/decoder/intgemm/intgemm_8bit.avx512.expected.bleu
new file mode 100644
index 0000000..64b1b85
--- /dev/null
+++ b/tests/decoder/intgemm/intgemm_8bit.avx512.expected.bleu
@@ -0,0 +1 @@
+BLEU+case.mixed+numrefs.1+smooth.exp+tok.13a+version.1.2.12 = 29.0 66.0/37.3/23.3/14.8 (BP = 0.956 ratio = 0.957 hyp_len = 2716 ref_len = 2838)
diff --git a/tests/decoder/intgemm/intgemm_8bit_shifted.avx.expected b/tests/decoder/intgemm/intgemm_8bit_shifted.avx.expected
new file mode 100644
index 0000000..2224287
--- /dev/null
+++ b/tests/decoder/intgemm/intgemm_8bit_shifted.avx.expected
@@ -0,0 +1,100 @@
+Four members of the Kemerovo group detained in Estonia and Spain
+According to the Post, police detained Slava Gulevich, the leader of the so-called Kemerovo group in the Estonian underworld, known in the criminal world as Slava Kemerovsky.
+Gulevich, who was detained in Spain, was arrested with court permission.
+Yesterday, the court also took custody of three suspects detained in Estonia.
+The suspect is said to be members of the so-called Kemerovo Criminal Society between the ages of 27 and 57, who are mainly involved in drug offences.
+The alleged leader of a criminal association has been detained in Mijase, Spain.
+Three men were arrested on suspicion of suspects in Estonia, one of whom is a leading figure in a criminal association and two are members of the criminal association, according to the data collected.
+The data collected indicate that the roles and roles were clearly distributed in the criminal community.
+The purpose of the criminal association's activities was to commit drug offences and thus generate criminal proceeds," said Vahur Verte, the head of pre-trial proceedings in the criminal case.
+"We are not ruling out an increase in the number of suspects in this criminal case," the prosecutor added.
+These are people who have been in the interest of law enforcement in the past, and some have been punished for drug offences.
+Verte stressed that cooperation with its Spanish counterparts has been important throughout the investigation.
+"International cooperation has become commonplace for us, and this week's operation shows the success of cooperation," said prosecutor Verte.
+Ago Leis, head of the Central Criminal Police Service, said the arrests were preceded by a year-and-a-half probe.
+"In the first half of the year, the long-running work materialised and we simultaneously detained suspects of crimes in Estonia and in Spain," he said.
+Leis added that Central Criminal Police officers were assisting in the arrest in Spain.
+We have had good contact and understanding with the Spanish police and the Civil Guard for years.
+These arrests are yet another message to criminals that we will get them from the other end of Europe," Leis said.
+The information gathered so far clearly indicates that the men who have been charged may continue to commit new crimes, which is why the prosecution has requested their arrest and the court approved it.
+A man arrested in Spain is awaiting transfer to Estonia.
+Property, vehicles and cash have been seized in this criminal case to ensure confiscation.
+The pre-trial proceedings in the case are carried out by the Central Criminal Police Organised Crime Bureau and led by the Crown Prosecution Service.
+Slava Gulevich was convicted of extortion and sentenced to five years in prison by the Tallinn district court in 2005.
+In the middle of last decade, Gulevich was considered the second most important man in the Estonian criminal world after Nikolai Tarankov, then the underworld leader.
+Gulevich, from Kemerovo, rose to prominence in the Estonian underworld in the early 1990s when he began to deal with extortion in Tallinn.
+He allegedly taxided taxi drivers and prostitutes who operated at various hotels and charged businessmen with monthly rookie fees.
+International joint operations, confiscations of criminal proceeds and court rulings that have come into force confirm that the fight in the area of organised crime is effective.
+For example, the latest court rulings, eight defendants from the so-called Dikayev Criminal Community criminal case who were ordered to have seized EUR 80,000 for the conviction of nine individuals in 2006 for a criminal association aimed at the illegal trade of cigarettes and the committing of crimes related to human trafficking in the East Village and the South in Estonia in 2006.
+Confidential criminal proceeds there are around 71,500 euros.
+In these criminal matters, it has ensured that police officers exchange information and evidence with foreign colleagues every day, and if necessary, procedures are carried out together in any European Union country.
+Civil rights group warns against travel to Missouri
+The National Association for the Advancement of Colored People (NAACP) has warned black people travelling to Missouri against discriminatory policies and racist attacks in the state.
+The group's statement reads: "An NAACP travel note issued for the state of Mussuri, which runs until August 28, 2017, calls on all African-American travelers, visitors and Missouriers to be particularly attentive and extremely careful when moving around the state, given the entire squad of suspicious racial-based events that have occurred recently and are brought out here across the state."
+The NAACP said the group urged the travel warning to issue both a recent Missouri law that makes it harder to win discrimination lawsuits and the fact that the state's law enforcement targets are largely minorities.
+"People's civil rights are violated.
+They are pulled onto the side of the road because of the colour of their skin, they are beaten or killed," Rod Chapel, president of the Missouri branch of the NAACP, told The Kansas City Star.
+'We've never had so close complaints before.'
+It is the first such warning the organization has issued about the U.S. state.
+The group cited events such as racist insults at the University of Missouri and the death of 28-year-old black Tory Sanders, a 28-year-old black man from Tennessee.
+Sanders died in suspicious circumstances earlier this year after he ran out of petrol while driving through the state and was taken into custody by Missouri police without being charged with a crime.
+In addition, the note refers to a recent report by the Missouri Attorney General, which shows that in the state, cars of black motorists are 75% more likely to be stopped than those of white women.
+"It's meant to make people aware and warn their families, friends and co-workers about what might happen in Missouri," Chapel said.
+"People have to be prepared, whether it means taking bail money or informing relatives that they are going through the state," he said.
+According to the latest data from the FBI's hate crime reporting program, Missouri documented 100 hate crimes in 2015, putting the state in 16th place in the state's total in the state.
+The travel warning is also in response to a new law in Missouri, which makes it difficult for the company to sue for discrimination in the search for housing or work.
+The American Civil Liberties Union (American Civil Liberties Union) had previously issued travel notes for Texas and Arizona after those states passed immigration laws that required local authorities to arrest people for immigration violations because the ACLU said it would increase racial profiling.
+Typically, travel warnings are issued by the State Department for other countries, but recently interest groups have started using the measure as a counter-reaction to certain laws and trends within the U.S..
+Hepatitis: what would anyone know about the different forms of this serious disease?
+Hepatitis, or liver inflammation, can be caused by five different, A, B, C, D and E.
+All these viruses trigger acute inflammation of liver tissue.
+However, chronic hepatitis B and C have a negative cost, which can develop into cirrhosis of the liver, or liver wrinkles and liver cancer.
+Listo Kutsar, an epidemiology adviser at the Department of Health, says acute hepatitis disease is the same for all types of liver inflammation - fever, fatigue, plantation, nausea, vomiting, abdominal pain, dull outlets, dark urine, muscular and joint pain, and the yellowness of the skin and mucus.
+The popular name collie disease of liver inflammation also comes from the latest disease.
+In children, hepatitis can go without signs of disease.
+Different types of inflammation can only be identified based on data from laboratory studies.
+Extreme hepatitis can transition into chronic hepatitis and run for decades without signs of disease, meaning a person may not know anything about their dangerous liver-damaging disease.
+Mr Kutsar points out different forms of hepatitis and describes their progress in more detail.
+Hepatitis A viruses spread from sick people and infect us by eating contaminated food or drinking water, through sex, from the stool of an infected person to their hands and from their hands to food, objects, objects, mouth and taking drugs.
+Family members and caregivers of the risk of hepatitis infection, known as risk-taking, people with chronic liver disease, people having sex with infected people, men having sex with men, drug addicts, travelers visiting countries with hepatitis A high spread.
+Infectiousness can be prevented by vaccination, in particular for people travelling in a hepatitis A risk group, in particular, vaccination for people travelling at risk of A.
+In addition, daily hygiene compliance is essential: wash or disinfect all fruit and vegetables before using them for food.
+Hepatitis B viruses are spread when a patient's blood is exposed to, injected with drugs, tattooing, hole-in-dural, blood-soaked creatures (toothbrushes, waste products), having sex with donor blood, hepatitis sushi to person, and having hepatitis from mother to foetus/born.
+Inspiring drug addicts, sex partners of infected person who have sex with men, newborns of an infected mother, sick family members and carers, health care workers and police officers who come into contact with blood and other bodily fluids, and travelers visiting countries with high levels of hepatitis B.
+It is possible to vaccinate people in order to prevent hepatitis B; in particular, people at risk have been recommended, as well as those with chronic liver disease, HIV infection, sexually transmitted diseases and diabetes.
+Other preventive measures for hepatitis B include: avoiding the use of alien hygiene and manicure products, other sharpeners and syringes, tattooing and holeing, and using condoms for infectious sex or avoiding sexual risk behavior.
+Vaccination against hepatitis B is free for children in Estonia as part of the national immunisation scheme and is free for children.
+Hepatitis C viruses are spread when exposed to the blood of a sick person, injecting drugs, tattooing, holed up, using blood-soaked creatures, donor blood, having sex with hepatitis a person, and from a hepatitis patient to the foetus/naive.
+The risk group for hepatitis C infection includes injection drug addicts, infected human sex partners, men having sex with men, newborns of an infected mother, sick family members and carers, health, rescue workers and police officers exposed to blood and other bodily fluids, and travelers visiting countries with high levels of hepatitis C.
+The prevention measure for hepatitis C is: avoiding the use of alien hygiene and manicure, other sharpeners and syringe-infested skulls, tattooing and sniffing, and using condoms in cases of infection-prone sex.
+There is no vaccine against hepatitis C.
+Hepatitis D is caused by the hepatitis D virus, which reproduces in the presence of the hepatitis B virus.
+As a result, hepatitis D infection occurs in hepatitis B or a super-infection in chronic hepatitis B patients.
+Hepatitis D viruses are spread when exposed to blood and other bodily fluids, their contaminated needles, sexually transmitted and from the rarely infected mother to the fetus.
+Hepatitis D is a risk group for chronic hepatitis B virus carriers and people who do not have immunity against hepatitis B.
+An effective preventive measure is vaccination with the hepatitis B vaccine, which also protects people from infection with the hepatitis D virus.
+Hepatitis viruses spread through drinking water and food on fetal-oral tea, including eating low-heated beef, fish and sea cucumbers, donor blood, commonly used syringes and infected mother to foetus.
+Travellers can become infected in countries with hepatitis E high disease.
+Hepatitis prevention measures include meeting hygiene requirements: wash or disinfect your hands after going to the toilet, before cooking and eating, after caring for the sick.
+Fruit and vegetables to wash before consumption, avoid eating low-heated beef, fish and seafood, drink only safe drinking water and avoid drug use.
+While the competitors tried to sprint off the four-time Olympic champion in the final round, 34-year-old Farah found strength in the final round and won in a time of 26.49.51.
+Farah didn't think long, pulling his wife Tania and the children along the way after the finish.
+It was a special moment for me.
+I greatly miss my family.
+Being on the track with them was wonderful," Farah told reporters.
+Farah is aiming for a golden duo of the fifth title race in a row in London with a 5,000 and 10,000 meters runner-up.
+Anything is possible if you believe in it.
+Despite the title, Anne-Marie O'Connor's "Daam in Gold; Gustav Klimt's masterpiece, the extraordinary story of Adele Bloch-Bauer's portrait" delves much deeper into the cultural life of one art work from the late 19th and early 20th centuries of Vienna.
+But even more in history.
+The awesome amount of information might have been worn out, perhaps a louder cut, a narrower subject allowed to allow the portrait allowed in the title to become more of an influence.
+There would be two books on the cover now: the story of Adele Bloch-Bauer, portrayed in her painting "Daam in Gold," and a much larger and more comprehensive historical history book about the esteemed Jewish family and the German occupation, along with its aftermath in Austria.
+The first third of the book leads to the scorching Vienna cultural life in the midst of the puzzling Vienna, and whoever has entered the Austrian capital, can imagine, without the slightest effort, how life went around Ringstrasse more than 100 years ago, or how everyone turned their heads in the café in Central when Klimt stepped in.
+The concentration of cultural figures was high in one of Europe's richest cities, and when you see the familiar name in the book, you feel like a more grammar of cultures.
+At the same time, for example, the fact that Sigmund Freud operated in a city where incurable syphilis was rampant and had the highest suicide rate in Europe seems to add to the development of the story.
+Or, perhaps, every pair of brushstrokes adds colour to the cultural life of the early 20th century in Vienna.
+The dream of a trip to the Soviet Union
+In the last decades of the 19th century, the number of Jews in Vienna had exploded, becoming the largest Jewish community in Western Europe.
+At the turn of the century, almost one in ten residents of Vienna was a Jew.
+Adele's parents were also newcomer to Vienna, but by the time Adele married herself twice to open a Czech sugarmay magnate, Ferdinand Bloch, and Klimt was posing for her famous paintings, her father's bank had already become the seventh largest bank in the Habsburg empire.
+But Adelet didn't draw all the glamorous life to which she belonged.
+If you look at "Dama in gold," it's hard to believe that, towards the end of her life, this great lady became infected with socialism and dreamed of a trip to the Soviet Union.
diff --git a/tests/decoder/intgemm/intgemm_8bit_shifted.avx.expected.bleu b/tests/decoder/intgemm/intgemm_8bit_shifted.avx.expected.bleu
new file mode 100644
index 0000000..38cc990
--- /dev/null
+++ b/tests/decoder/intgemm/intgemm_8bit_shifted.avx.expected.bleu
@@ -0,0 +1 @@
+BLEU+case.mixed+numrefs.1+smooth.exp+tok.13a+version.1.2.12 = 30.1 65.2/37.7/23.7/15.4 (BP = 0.977 ratio = 0.977 hyp_len = 2774 ref_len = 2838)
diff --git a/tests/decoder/intgemm/intgemm_8bit_shifted.avx2.expected b/tests/decoder/intgemm/intgemm_8bit_shifted.avx2.expected
new file mode 100644
index 0000000..675fcb0
--- /dev/null
+++ b/tests/decoder/intgemm/intgemm_8bit_shifted.avx2.expected
@@ -0,0 +1,100 @@
+Four members of the Kemerovo group detained in Estonia and Spain
+According to the Post, police detained Slava Gulevich, the leader of the so-called Kemerovo group in the Estonian underworld, known in the criminal world as Slava Kemerovsky, by police in Spain.
+Gulevich, who was detained in Spain, was arrested with court permission.
+Yesterday, the court also took custody of three suspects detained in Estonia.
+The suspect is said to be members of the so-called Kemerovo Crime Society aged 27 to 57, mainly committing drug offences.
+The alleged leader of a criminal association has been detained in Mijas, Spain's Malaga province.
+Three men were arrested on suspicion in Estonia, one of whom is a leading figure in the criminal association, according to the data collected, and two are members of the criminal association.
+The data collected indicate that the roles and roles were clearly divided in the criminal community.
+The purpose of the criminal association's activities was to commit drug crimes and thus generate criminal proceeds," said Mr Verte, head of pre-trial proceedings in the criminal case.
+"We are not ruling out increasing the number of suspects in this case," the prosecutor added.
+These are people who have been in the interest of law enforcement authorities in the past, and some have served sentences for drug crimes.
+Verte stressed that cooperation with his Spanish counterparts had been important throughout the investigation.
+"International cooperation has become commonplace for us, and this week's operation shows the success of the collaboration," prosecutor Verte said.
+Ago Leis, head of the Metropolitan Police Service, said the arrests were preceded by a probation of nearly a year and a half.
+"In the first half of the year, the long-running work materialised and we simultaneously detained suspects of crimes in Estonia and Spain," he said.
+The inquest added that Central Criminal Police officers were assisting in the arrest in Spain.
+For years now, we have had good contact and understanding with the Spanish police and the Civil Guard.
+These arrests are yet another message to criminals that we will get them from the other end of Europe," Leis said.
+The information gathered so far clearly indicates that the men who have been charged can continue to commit new crimes, which is why the prosecution has requested their arrest and the court approved it.
+A man arrested in Spain is awaiting transfer to Estonia.
+Property, vehicles and cash have been seized as part of this criminal case.
+The pre-trial proceedings in the case are carried out by the Central Criminal Police Organised Crime Bureau and led by the Crown Prosecution Service.
+Slava Gulevich was found guilty of extortion in 2005 by a district court in Tallinn and sentenced to five years in prison.
+In the middle of the last decade, Gulevich was considered the second most important man in the Estonian criminal world after Nikolai Tarankov, then the underworld leader.
+Gulevich, from Kemerovo, rose to prominence in the Estonian underworld in the early 1990s when he became involved in extortion in Tallinn.
+He allegedly taxiderned taxi drivers and prostitutes operating at various hotels and charged businessmen with monthly rookie fees.
+International joint operations, confiscations of criminal proceeds and court judgments that have come into force confirm that the fight in the area of organised crime is effective.
+For example, the latest court rulings, eight defendants separated from the so-called Dikayev Criminal Association criminal case, for whom the proceeds of criminal were seized, or the judgment of nine individuals in 2006 for Igor Aleynikov to set up a criminal association aimed at the illegal trade of cigarettes and committing crimes related to human trafficking in East Virginia and the South of Estonia.
+Confirmed criminal proceeds there are around 71,500 euros.
+In these criminal matters, progress has been made by the fact that police officers exchange information and prosecutors with foreign colleagues every day and, if necessary, carry out actions together in any European Union country.
+Civil rights group warns against travel to Missouri
+The National Association for the Advancement of Colored People (NAACP) has warned black people travelling to Missouri against discriminatory policies and racist attacks in the state.
+The group's statement reads: "A NAACP travel note issued for the state of Midsuad, which runs until August 28, 2017, invites all African-American travelers, visitors and Missourians to be particularly vigilant and extremely careful as they move around the state, taking into account the suspicious racially-based events that have occurred recently across the state."
+The NAACP said the group urged both the recent Missouri law to issue a travel warning, making it more difficult to win discrimination lawsuits, and the fact that the state's law enforcement officers target for an unequally large number of minorities.
+"People's civil rights are violated.
+They are pulled on the side of the road because of the colour of their skin, beaten or killed," Rod Chapel, president of the Missouri branch of the NAACP, told The Kansas City Star.
+'We've never had so close complaints before.'
+It is the first such warning issued by the organization about the U.S. state.
+The group cited events such as racist insults at the University of Missouri and the death of Tory Sanders, a 28-year-old black man from Tennessee.
+Sanders died in suspicious circumstances earlier this year after he ran out of petrol while driving through the state and was taken into custody by Missouri police without being charged with a crime.
+In addition, the note refers to a recent report by the Missouri attorney general, which shows that cars of black motorists in the state are 75% more likely to be stopped than white people.
+"It's meant to make people aware and warn their families, friends and co-workers about what might happen in Missouri," Chapel said.
+"People have to be prepared, that means taking bail money or informing relatives that they are going through the state," he said.
+According to the latest data from the FBI's hate crime reporting program, 100 hate crimes were documented in Missouri in 2015, putting the state 16th in the state's number of similar violations.
+The travel warning is also a response to Missouri's new law, which makes it difficult for the company to sue for discrimination in the search for housing or work.
+The American Civil Liberties Union (American Civil Liberties Union) had previously issued travel notes for Texas and Arizona after those states passed immigration laws that required local authorities to arrest people for immigration violations because the ACLU said it would increase racial profiling.
+Typically, travel warnings are issued by the Department of Foreign Affairs for other countries, but recently interest groups have started using the measure as a counter-reaction to certain laws and trends within the United States.
+Hepatitis: what would anyone know about the different forms of this serious disease?
+Hepatitis, or liver inflammation, can be caused by five different, A, B, C, and hepatitis E viruses.
+All these viruses trigger acute inflammation of liver tissue.
+However, chronic hepatitis B and C, which can develop into liver cirrhosis, or liver wrinkles and liver cancer, is a poor cost.
+Listo Kutsar, an epidemiology adviser at the Department of Health, says acute hepatitis is the same for all types of liver inflammation - fever, fatigue, appetite, nastiness, vomiting, abdominal pain, sneezes, numb urine, muscle and joint pain, and the collar of the skin and mucus.
+The most recent disease also comes from the popular name for liver inflammation.
+In children, hepatitis can go without signs of disease.
+Different types of inflammation can only be determined by data from a laboratory study.
+Extreme hepatitis can transition into chronic hepatitis and run for decades without signs of disease, meaning a person may not know anything about their dangerous liver-disturbing disease.
+Mr Kutsar points out different forms of hepatitis and describes their progress in more detail.
+Hepatitis A viruses spread from sick people and infect us when eating contaminated food or drinking water, through sex, from the stool of an infected person to their hands and arms to food, objects, objects, in the mouth and taking drugs.
+The risk of hepatitis infection, or at-risk group, includes family members and carers suffering from chronic liver disease, people having sex with infected people, men having sex with men, drug addicts, travelers visiting countries with hepatitis A high-proteined countries.
+Infectiousness can be prevented by vaccination, in particular for people travelling at risk of vaccination and those at risk of hepatitis A.
+In addition, daily hygiene compliance is important: wash or disinfect all fruit and vegetables before using them for food.
+Hepatitis B viruses are spread when exposed to the blood of a sick person, injecting drugs, tattooing, hole-in-cheek, using blood-soaked creatures (toothbrushes, squatting tools), having donor blood, having sex with a hepatitis-boy person, and having hepatitis from a mother to foetal/born.
+The injection drug addicts, sex partners of infected person who have sex with men, newborns of infected mother, sick family members and carers, health care workers and police officers exposed to blood and other bodily fluids, and travelers visiting countries with high levels of hepatitis B.
+It is possible to vaccinate people in order to prevent hepatitis B; in particular, people at risk have been recommended, as well as those with chronic liver disease, HIV infections, sexually transmitted diseases and diabetes.
+Other preventive measures for hepatitis B include: avoiding the use of foreign hygiene and manicure, other sharpeners and syringes and needles, tattooing and holeing, and using a condom in the event of infection-prone sex or avoiding sexual risk behaviour.
+Vaccination against hepatitis B is free of charge for children in Estonia as part of the national immunisation scheme.
+Hepatitis C viruses are spread when exposed to the blood of a sick person, injecting drugs, tattooing, hole-in-armed, using blood-soaked creatures, donor blood, having sex with hepatitis a person, and from hepatitis to mother to foetus/connaissance.
+The risk group for hepatitis C infection includes injection drug addicts, sex partners of an infected person, men having sex with men, newborns of an infected mother, sick family members and carers, health care workers and police officers exposed to blood and other bodily fluids, and travelers visiting countries with hepatitis C high disease.
+The preventive measure for hepatitis C is: avoiding the use of foreign hygiene and manicure products, other sharpeners and syringe-indulging, and using condoms for infectious sex.
+There is no vaccine against hepatitis C.
+Hepatitis D is caused by a hepatitis D virus that reproduces in the presence of the hepatitis B virus.
+As a result, hepatitis D infection is associated with hepatitis B or a super infection in patients with chronic hepatitis B.
+Hepatitis D viruses spread when exposed to blood and other bodily fluids, with contaminated needles, sexually transmitted and rarely infected mother to the foetus.
+The risk group for hepatitis D is chronic hepatitis B virus carriers and people who do not have immunity against hepatitis B.
+An effective preventive measure is vaccination with the hepatitis B vaccine, which also protects people from infection with the hepatitis D virus.
+Hepatitis viruses spread through fetal-oral tea with drinking water and food, including eating low-heated beef, fish and sea cucumbers, donor blood, commonly used syringes and infected mother to foetus.
+Travellers can become infected in countries with hepatitis E high disease.
+Hepatitis prevention measures include meeting hygiene requirements: wash or disinfect your hands after going to the toilet, before cooking and eating, after caring for the sick.
+Beef and vegetables to wash before consumption, avoid eating low-heated beef, fish and seafood, drink only safe drinking water and avoid drug use.
+While rivals tried to get the four-time Olympic champion off the track in the final round, the 34-year-old Farah found strength in the final round and won in 26.49.51.
+Farah didn't think long, pulling his wife Tania and the children along the way after the finish.
+It was a special moment for me.
+I very much miss my family.
+Being on the track with them was wonderful," Farah told reporters.
+Farah is aiming for a 5,000-metre and golden double in the 10,000 meters for the fifth title race in London.
+Anything is possible if you believe in it.
+Despite the title, Anne-Marie O'Connor's "Daam in Gold. Gustav Klimt's masterpiece, the extraordinary story of Adele Bloch-Bauer's portrait" delves much deeper into the origin story of one art work in the late 19th and early 20th-century Vienna cultural life.
+But even more in history.
+The awesome amount of information would perhaps have been worn out, perhaps a louder cut, a narrower subject that allowed the portrait allowed in the title to become more of an influence.
+Today, there would be two books on the cover: the story of Gudele Klimt and his painting "Daam in Gold," and a much larger and more comprehensive historical record of the esteemed Jewish families and the German occupation, along with its aftermath in Austria.
+The first third of the book leads to the cultural life of the bustling Vienna, and who have themselves entered the Austrian capital, one can imagine how life around Ringstrasse more than 100 years ago, or how everyone turned their heads in the Central Cafe when Klimt stepped in.
+The concentration of cultural figures was high in one of Europe's richest cities, and when you see the name you know in the book, you feel like a more grammar of cultures.
+At the same time, for example, the fact that Sigmund Freud acted in a city where incurable syphilis was rampant and was the highest suicide rate in Europe gives nothing to the story's development.
+Or perhaps, anyway, every pair of brushstrokes adds colour to the cultural life of the early 20th century in Vienna.
+The dream of a trip to the Soviet Union
+In the last decades of the 19th century, the number of Jews in Vienna had exploded, becoming the largest Jewish community in Western Europe.
+At the turn of the century, nearly one in ten residents of Vienna was a Jew.
+Adele's parents were also newcomers to Vienna, but by the time Adele married her two-time ex-hungry Czech sugar magnate Ferdinand Bloch and posed for Klimt for her famous paintings, her father's bank had already become the seventh largest bank in the Habsburg empire.
+But Adelet didn't pull the whole glamorous life to which she belonged.
+If you look at "Damid in gold," it's hard to believe that, towards the end of their lives, this great lady became infected with socialism and dreamed of a trip to the Soviet Union.
diff --git a/tests/decoder/intgemm/intgemm_8bit_shifted.avx2.expected.bleu b/tests/decoder/intgemm/intgemm_8bit_shifted.avx2.expected.bleu
new file mode 100644
index 0000000..83a6c0f
--- /dev/null
+++ b/tests/decoder/intgemm/intgemm_8bit_shifted.avx2.expected.bleu
@@ -0,0 +1 @@
+BLEU+case.mixed+numrefs.1+smooth.exp+tok.13a+version.1.2.12 = 30.1 66.0/38.5/24.2/15.5 (BP = 0.964 ratio = 0.964 hyp_len = 2737 ref_len = 2838)
diff --git a/tests/decoder/intgemm/intgemm_8bit_shifted.avx512.expected b/tests/decoder/intgemm/intgemm_8bit_shifted.avx512.expected
new file mode 100644
index 0000000..ec616aa
--- /dev/null
+++ b/tests/decoder/intgemm/intgemm_8bit_shifted.avx512.expected
@@ -0,0 +1,100 @@
+Four members of the Kemerovo group detained in Estonia and Spain
+According to the Post, police detained Slava Gulevich, the leader of the so-called Kemerovo group in the Estonian underworld, known in the criminal world as Slava Kemerovsky, was detained by police in Spain.
+Gulevich, who was detained in Spain, was arrested with court permission.
+Yesterday, the court also took custody of three suspects detained in Estonia.
+The suspect is said to be members of the so-called Kemerovo Crime Society aged 27-57, mainly committing drug offences.
+The alleged leader of a criminal association has been detained in Mija.
+Three men were arrested on suspicion in Estonia, one of whom is a leading figure in the criminal association, according to the data collected, and two are members of the criminal association.
+The data collected indicate that the roles and roles were clearly divided in the criminal community.
+The purpose of the criminal association's activities was to commit drug crimes and thus generate criminal proceeds," said Mr Verte, head of pre-trial proceedings in the criminal case.
+"We are not ruling out increasing the number of suspects in this case," the prosecutor added.
+These are people who have been in the interest of law enforcement in the past, and some have served sentences for drug crimes.
+Verte stressed that cooperation with his Spanish counterparts had been important throughout the investigation.
+"International cooperation has become commonplace for us, and this week's operation shows the success of the collaboration," said prosecutor Verte.
+Ago Leis, head of the Metropolitan Police Service, said the arrests were preceded by a probation for nearly a year and a half.
+"In the first half of the year, the long-running work materialised and we simultaneously detained suspects of crimes in Estonia and Spain," he said.
+The inquest added that Central Criminal Police officers were assisting in the arrest in Spain.
+For years now, we have had good contact and understanding with the Spanish police and the Civil Guard.
+These arrests are yet another message to criminals that we will get them from the other end of Europe," Leis said.
+The information gathered so far clearly indicates that the men who have been charged can continue to commit new crimes, which is why the prosecution requested their arrest and the court approved it.
+A man arrested in Spain is awaiting transfer to Estonia.
+Property, vehicles and cash have been seized as part of this criminal case to ensure confiscation.
+The pre-trial proceedings in the case are carried out by the Central Criminal Police Organised Crime Bureau and led by the Crown Prosecution Service.
+Slava Gulevich was convicted of extortion and sentenced to five years in prison by a district court in Tallinn.
+In the middle of the last decade, Gulevich was considered the second most important man in the Estonian criminal world after Nikolai Tarankov, then the underworld leader.
+Gulevich, from Kemerovo, rose to prominence in the Estonian underworld in the early 1990s when he began to engage in extortion in Tallinn.
+He allegedly taxiderned taxi drivers and prostitutes operating at various hotels and demanded monthly rookie fees from businessmen.
+International joint operations, confiscations of criminal proceeds and court judgments that have come into force confirm that the fight in the area of organised crime is effective.
+For example, the latest court rulings, eight defendants separated from the so-called Dikayev Crime Command, who were ordered to pay the proceeds of BGN 80,000, or the judgment against nine individuals, in 2006 for Igor Aleynikov, who set up a criminal association aimed at the illegal trade of cigarettes and the crimes of human trafficking in East Virginia and the South in Estonia.
+Confirmed criminal proceeds there are around 71,500 euros.
+In these criminal matters, progress has been made by the fact that police officers exchange information and prosecutors with foreign colleagues every day and, if necessary, carry out actions together in any European Union country.
+Civil rights group warns against travel to Missouri
+The National Association for the Advancement of Colored People (NAACP) has warned black people travelling to Missouri against discriminatory policies and racist attacks in the state.
+The group's statement reads: "A NAACP travel note issued for the state of Midsor, which runs until August 28, 2017, invites all African-Americans, visitors and Missouriers to be particularly attentive and extremely careful when moving around the state, taking into account the suspicious racially-based events that have occurred recently across the state."
+The NAACP said the group urged both the recent Missouri law to issue a travel warning, making it harder to win antitrust lawsuits and the fact that the state's law enforcement officers target minorities in an unequal way.
+"People's civil rights are violated.
+They are pulled onto the side of the road because of their skin color, they are beaten or killed," Rod Chapel, president of the Missouri branch of the NAACP, told The Kansas City Star.
+'We've never had so close complaints before.'
+It is the first such warning issued by the organization about the U.S. state.
+The group cited events such as racist insults at the University of Missouri and the death of a 28-year-old black man from Tennessee, Tory Sanders.
+Sanders died in suspicious circumstances earlier this year after he ran out of petrol while driving through the state and was taken into custody by Missouri police without being charged with a crime.
+In addition, the note points to a recent report by the Missouri attorney general, which shows that in the state, black motorists are 75% more likely to be stopped than white people.
+"It's meant to make people aware and warn their families, friends and co-workers about what might happen in Missouri," Chapel said.
+"People have to be prepared, that means taking bail money or informing relatives that they are going through the state," he said.
+According to the latest data from the FBI's hate crime reporting program, 100 hate crimes were documented in Missouri in 2015, putting the state 16th in the state's number of similar violations.
+The travel warning is also a response to Missouri's new law, which makes it difficult for the company to sue for discrimination in the search for housing or work.
+The American Civil Liberties Union (American Civil Liberties Union) had previously issued travel notes for Texas and Arizona after those states passed immigration laws that required local authorities to arrest people for immigration violations because the ACLU said it would increase racial profiling.
+Typically, travel warnings are issued by the Department of Foreign Affairs for other countries, but recently interest groups have started using the measure as a counter-reaction to certain laws and trends within the US.
+Hepatitis: what would anyone know about the different forms of this serious disease?
+Hepatitis, or liver inflammation, can be caused by five different, A, B, C, and E hepatitis viruses.
+All these viruses trigger acute inflammation of liver tissue.
+However, chronic hepatitis B and C is chronic, which can develop into the liver cirrhosis, or liver wrinkles and liver cancer, has a negative cost.
+Mood Kutsar, an epidemiology adviser to the NHS, says acute hepatitis disease is the same for all types of liver inflammation - fever, fatigue, appetite, nastiness, vomiting, abdominal pain, numb urine, muscular and joint pain and the collarbone of the skin and mucus.
+The most recent disease also comes from the popular name of liver inflammation, collaboratories.
+In children, hepatitis can go without signs of disease.
+Different types of inflammation can only be determined by data from a laboratory study.
+Extreme hepatitis can transition into chronic hepatitis and run for decades without signs of disease, meaning a person may not know anything about their dangerous liver-damaging disease.
+Mr Kutsar points out different forms of hepatitis and describes their progress in more detail.
+Hepatitis A viruses spread from sick people and infect us when eating contaminated food or drinking water, through sex, from the stools of an infected person to their hands and from their hands to food, surfaces, objects, objects, mouths and taking drugs.
+Family members and carers of the disease, who are at risk of hepatitis infection, people with chronic liver disease, people having sex with infected people, men having sex with men, drug addicts, travelers visiting countries with hepatitis A high.
+Infectiousness can be prevented by vaccination, in particular for people travelling at risk of hepatitis A, who are widely involved in the hepatitis A.
+In addition, daily hygiene compliance is essential: wash or disinfect all fruit and vegetables before using them for food.
+Hepatitis B viruses are spread when exposed to the blood of a sick person, injecting drugs, tattooing, hole-in-cheek, using blood-soaked creatures (toothbrushes, raspberry tools), donor blood, having sex with hepatitis-boyfriend, and having sex with a hepatitis-studded mother to foetal/born.
+The injection drug addicts, sex partners of an infected person, men having sex with men, the newborns of an infected mother, sick family members and carers, health care, rescue workers and police officers who are exposed to blood and other bodily fluids, and travelers visiting countries with high hepatitis B.
+It is possible to vaccinate people in order to prevent hepatitis B; in particular, people at risk have been recommended, as well as those with chronic liver disease, HIV infections, sexually transmitted diseases and diabetes.
+Other preventive measures for hepatitis B include: avoiding the use of foreign hygiene and manicured equipment, other sharpeners and needles, tattooing and hole-in-duty, and the use of condoms in the event of infection-prone sex or avoiding sexual risk behavior.
+Vaccination against hepatitis B is free of charge for children in Estonia as part of the national immunisation scheme.
+Hepatitis C viruses are spread when exposed to the blood of a sick person, injecting drugs, tattooing, holed up, using blood-soaked creatures, donor blood, having sex with a hepatitis person, and from a hepatitis patient to the foetus/naive.
+The risk of hepatitis C infection includes injection drug addicts, sex partners of an infected person, men having sex with men, infected mother's newborns, sick family members and carers, health, rescue workers and police officers exposed to blood and other bodily fluids, and travelers visiting countries with hepatitis C.
+The preventive measure for hepatitis C is: avoiding the use of foreign hygiene and manicured equipment, other sharpeners and needles, tattooing and sniffing, and the use of condoms in cases of infection-prone sex.
+There is no vaccine against hepatitis C.
+Hepatitis D is caused by a hepatitis D virus that reproduces in the presence of the hepatitis B virus.
+As a result, hepatitis D infection is associated with hepatitis B or a super infection in patients with chronic hepatitis B.
+Hepatitis D viruses are spread through contact with blood and other bodily fluids, with contaminated needles, sexually and from the rarely infected mother to the foetus.
+The risk group for hepatitis D is chronic hepatitis B virus carriers and people who do not have immunity against hepatitis B.
+An effective preventive measure is vaccination with the hepatitis B vaccine, which also protects people from infection with the hepatitis D virus.
+Hepatitis viruses spread through fetal-oral drinking water and food, including eating low-heated beef, fish and sea cucumbers, donor blood, commonly used syringes and infected mother to foetus.
+Travellers can become infected in countries with hepatitis E high disease.
+Hepatitis prevention measures include hygiene requirements: wash or disinfect your hands after going to the toilet, before cooking and eating, after caring for the sick.
+Beef and vegetables to wash before consumption, avoid eating low-heated beef, fish and seafood, drink only safe drinking water and avoid drug use.
+While rivals tried to squeeze the four-time Olympic champion off course in the final round, 34-year-old Farah found strength in the final round and won in 26.49.51.
+Farah didn't think long, pulling his wife Tania and the children along the way after the finish.
+It was a special moment for me.
+I very much miss my family.
+Being on the track with them was wonderful," Farah told reporters.
+Farah is aiming for a 5,000-metre and golden doubles for the fifth title race in a row in London.
+Anything is possible if you believe in it.
+Despite the title, Anne-Marie O'Connor's "Daam in Gold; Gustav Klimt's masterpiece, Adele Bloch-Bauer's Portrait of Ancient, delves much deeper into the origin story of one of the artworks" from the birth story of the late 19th and early 20th-century Vienna.
+But even more in history.
+The glorious amount of information might have been worn out, perhaps a louder cut, a narrower subject allowed to allow the portrait allowed in the title to become more of an influence.
+There would be two books now on the cover: the story of Adele Bloch-Bauer, depicted in her painting "Daam in Gold," and a far larger and more comprehensive historical record of esteemed Jewish families and the German occupation, along with its aftermath in Austria.
+The first third of the book leads to the cultural life of Vienna in the midst of a bustling Vienna, and whoever finds themselves in the Austrian capital, one can imagine how life around Ringstrasse more than 100 years ago, or how everyone in Central Cafe turned his head when Klimt stepped in.
+The concentration of cultural figures was high in one of Europe's richest cities, and when you see the name you know in the book, you feel like a more grammar culture.
+At the same time, for example, the fact that Sigmund Freud acted in a city where incurable syphilis and was the highest suicide rate in Europe gives nothing to the development of the story.
+Or perhaps, anyway, every pair of brushstrokes add colour to the cultural life of the early 20th century in Vienna.
+The dream of a trip to the Soviet Union
+In the last decades of the 19th century, the number of Jews in Vienna had exploded, becoming the largest Jewish community in Western Europe.
+At the turn of the century, nearly one in ten residents of Vienna was a Jew.
+Adele's parents were also newcomers to Vienna, but by the time Adele married herself twice to open a Czech sugar magnate, Ferdinand Bloch, and Klimt was posing for her famous paintings, her father's bank had already become the seventh largest bank in the Habsburg empire.
+But Adelet didn't pull the whole glamorous life to which she belonged.
+If you look at "Dami in gold," it's hard to believe that, towards the end of his life, this great lady became infected with socialism and dreamed of a trip to the Soviet Union.
diff --git a/tests/decoder/intgemm/intgemm_8bit_shifted.avx512.expected.bleu b/tests/decoder/intgemm/intgemm_8bit_shifted.avx512.expected.bleu
new file mode 100644
index 0000000..8a95343
--- /dev/null
+++ b/tests/decoder/intgemm/intgemm_8bit_shifted.avx512.expected.bleu
@@ -0,0 +1 @@
+BLEU+case.mixed+numrefs.1+smooth.exp+tok.13a+version.1.2.12 = 29.4 65.4/37.6/23.4/14.8 (BP = 0.968 ratio = 0.968 hyp_len = 2748 ref_len = 2838)
diff --git a/tests/decoder/intgemm/setup.sh b/tests/decoder/intgemm/setup.sh
new file mode 100644
index 0000000..fde77bc
--- /dev/null
+++ b/tests/decoder/intgemm/setup.sh
@@ -0,0 +1,14 @@
+# Skip if compiled without SentencePiece
+if [ ! $MRT_MARIAN_USE_SENTENCEPIECE ]; then
+    exit 100
+fi
+
+test -f $MRT_MODELS/student-eten/model.npz || exit 1
+test -f $MRT_MODELS/student-eten/lex.s2t   || exit 1
+test -f $MRT_MODELS/student-eten/vocab.spm || exit 1
+
+test -f newstest2018.src || python3 $MRT_TOOLS/sacrebleu/sacrebleu.py -t wmt18 -l et-en --echo src \
+    | head -n 100 > newstest2018.src
+test -f newstest2018.ref || python3 $MRT_TOOLS/sacrebleu/sacrebleu.py -t wmt18 -l et-en --echo ref \
+    | head -n 100 > newstest2018.ref
+
diff --git a/tests/decoder/intgemm/test_fbgemm_packed8_intgemm_int8.sh b/tests/decoder/intgemm/test_fbgemm_packed8_intgemm_int8.sh
new file mode 100644
index 0000000..9a18e1b
--- /dev/null
+++ b/tests/decoder/intgemm/test_fbgemm_packed8_intgemm_int8.sh
@@ -0,0 +1,55 @@
+#!/bin/bash
+
+#####################################################################
+# SUMMARY: Decode fbgemm + intgemm 8bit for the output layer
+# TAGS: cpu student shortlist intgemm fbgemm
+#####################################################################
+
+# Exit on error
+set -e
+
+# Skip if requirements are not met
+if [ ! $MRT_MARIAN_USE_FBGEMM ]; then
+    echo "Marian is not compiled with FBGEMM" 1>&2
+    exit 100
+elif ! grep -q "avx2" /proc/cpuinfo; then
+    echo "Your CPU does not support AVX2, which is required" 1>&2
+    exit 100
+fi
+
+# Outputs differ on CPUs supporting AVX AVX2 or AVX512
+suffix=avx2
+if grep -q "avx512_vnni" /proc/cpuinfo; then
+    suffix=avx512_vnni
+elif grep -q "avx512" /proc/cpuinfo; then
+    suffix=avx512
+fi
+
+prefix=fbgemm_intgemm_8bit
+
+
+# Remove previous outputs
+rm -f $prefix.out $prefix.$suffix.bin
+
+# Pack the model
+$MRT_MARIAN/marian-conv -f $MRT_MODELS/student-eten/model.npz -t $prefix.$suffix.bin --gemm-type packed8$suffix
+test -s $prefix.$suffix.bin
+
+# Run test
+$MRT_MARIAN/marian-decoder \
+    -m $prefix.$suffix.bin -v $MRT_MODELS/student-eten/{vocab.spm,vocab.spm} \
+    -i newstest2018.src -o $prefix.out \
+    -b 1 --mini-batch 32 --maxi-batch 100 --maxi-batch-sort src -w 128 \
+    --shortlist $MRT_MODELS/student-eten/lex.s2t 50 50 --cpu-threads 1 --int8 \
+    --quiet-translation
+
+# Print current and expected BLEU for debugging
+python3 $MRT_TOOLS/sacrebleu/sacrebleu.py newstest2018.ref < $prefix.out | tee $prefix.out.bleu
+cat $prefix.$suffix.expected.bleu
+
+# Compare with the expected output
+$MRT_TOOLS/diff.sh $prefix.out $prefix.$suffix.expected > $prefix.diff
+
+
+# Exit with success code
+exit 0
diff --git a/tests/decoder/intgemm/test_fbgemm_packed8_intgemm_int8_shifted.sh b/tests/decoder/intgemm/test_fbgemm_packed8_intgemm_int8_shifted.sh
new file mode 100644
index 0000000..24640d9
--- /dev/null
+++ b/tests/decoder/intgemm/test_fbgemm_packed8_intgemm_int8_shifted.sh
@@ -0,0 +1,56 @@
+#!/bin/bash
+
+#####################################################################
+# SUMMARY: Decode fbgemm + intgemm 8bit shifted for the output layer
+# TAGS: cpu student shortlist intgemm fbgemm
+#####################################################################
+
+# Exit on error
+set -e
+
+# Skip if requirements are not met
+if [ ! $MRT_MARIAN_USE_FBGEMM ]; then
+    echo "Marian is not compiled with FBGEMM" 1>&2
+    exit 100
+elif ! grep -q "avx2" /proc/cpuinfo; then
+    echo "Your CPU does not support AVX2, which is required" 1>&2
+    exit 100
+fi
+
+# Outputs differ on CPUs supporting AVX AVX2 or AVX512
+suffix=avx2
+if grep -q "avx512_vnni" /proc/cpuinfo; then
+    suffix=avx512_vnni
+elif grep -q "avx512" /proc/cpuinfo; then
+    suffix=avx512
+fi
+
+prefix=fbgemm_intgemm_8bit_shifted
+prefix_ref=fbgemm_intgemm_8bit
+
+
+# Remove previous outputs
+rm -f $prefix.out $prefix.$suffix.bin
+
+# Pack the model
+$MRT_MARIAN/marian-conv -f $MRT_MODELS/student-eten/model.npz -t $prefix.$suffix.bin --gemm-type packed8$suffix
+test -s $prefix.$suffix.bin
+
+# Run test
+$MRT_MARIAN/marian-decoder \
+    -m $prefix.$suffix.bin -v $MRT_MODELS/student-eten/{vocab.spm,vocab.spm} \
+    -i newstest2018.src -o $prefix.out \
+    -b 1 --mini-batch 32 --maxi-batch 100 --maxi-batch-sort src -w 128 \
+    --shortlist $MRT_MODELS/student-eten/lex.s2t 50 50 --cpu-threads 1 --int8shift \
+    --quiet-translation
+
+# Print current and expected BLEU for debugging
+python3 $MRT_TOOLS/sacrebleu/sacrebleu.py newstest2018.ref < $prefix.out | tee $prefix.out.bleu
+cat $prefix_ref.$suffix.expected.bleu
+
+# Compare with the expected output
+$MRT_TOOLS/diff.sh $prefix.out $prefix_ref.$suffix.expected > $prefix.diff
+
+
+# Exit with success code
+exit 0
diff --git a/tests/decoder/intgemm/test_intgemm_16bit.sh b/tests/decoder/intgemm/test_intgemm_16bit.sh
new file mode 100644
index 0000000..0826cc7
--- /dev/null
+++ b/tests/decoder/intgemm/test_intgemm_16bit.sh
@@ -0,0 +1,53 @@
+#!/bin/bash
+
+#####################################################################
+# SUMMARY: Decode intgemm 16bit with on-the-fly conversion
+# TAGS: cpu student shortlist intgemm
+#####################################################################
+
+# Exit on error
+set -e
+
+# Skip if requirements are not met
+if [ ! $MRT_MARIAN_USE_MKL ]; then
+    echo "Marian is not compiled with CPU" 1>&2
+    exit 100
+elif ! grep -q "avx" /proc/cpuinfo; then
+    echo "Your CPU does not support AVX, which is required" 1>&2
+    exit 100
+fi
+
+# Outputs differ on CPUs supporting AVX AVX2 or AVX512
+suffix=avx
+if grep -q "avx512_vnni" /proc/cpuinfo; then
+    suffix=avx512_vnni
+elif grep -q "avx512" /proc/cpuinfo; then
+    suffix=avx512
+elif grep -q "avx2" /proc/cpuinfo; then
+    suffix=avx2
+fi
+
+prefix=intgemm_16bit
+
+
+# Remove previous outputs
+rm -f $prefix.out
+
+# Run test
+$MRT_MARIAN/marian-decoder \
+    -m $MRT_MODELS/student-eten/model.npz -v $MRT_MODELS/student-eten/{vocab.spm,vocab.spm} \
+    -i newstest2018.src -o $prefix.out \
+    -b 1 --mini-batch 32 --maxi-batch 100 --maxi-batch-sort src -w 128 \
+    --shortlist $MRT_MODELS/student-eten/lex.s2t 50 50 --cpu-threads 1 --int16 \
+    --quiet-translation
+
+# Print current and expected BLEU for debugging
+python3 $MRT_TOOLS/sacrebleu/sacrebleu.py newstest2018.ref < $prefix.out | tee $prefix.out.bleu
+cat $prefix.$suffix.expected.bleu
+
+# Compare with the expected output
+$MRT_TOOLS/diff.sh $prefix.out $prefix.$suffix.expected > $prefix.diff
+
+
+# Exit with success code
+exit 0
diff --git a/tests/decoder/intgemm/test_intgemm_16bit_preprocessed.sh b/tests/decoder/intgemm/test_intgemm_16bit_preprocessed.sh
new file mode 100644
index 0000000..d29967e
--- /dev/null
+++ b/tests/decoder/intgemm/test_intgemm_16bit_preprocessed.sh
@@ -0,0 +1,58 @@
+#!/bin/bash
+
+#####################################################################
+# SUMMARY: Decode intgemm 16bit with a binary model
+# TAGS: cpu student shortlist intgemm
+#####################################################################
+
+# Exit on error
+set -e
+
+# Skip if requirements are not met
+if [ ! $MRT_MARIAN_USE_MKL ]; then
+    echo "Marian is not compiled with CPU" 1>&2
+    exit 100
+elif ! grep -q "avx" /proc/cpuinfo; then
+    echo "Your CPU does not support AVX, which is required" 1>&2
+    exit 100
+fi
+
+# Outputs differ on CPUs supporting AVX AVX2 or AVX512
+suffix=avx
+if grep -q "avx512_vnni" /proc/cpuinfo; then
+    suffix=avx512_vnni
+elif grep -q "avx512" /proc/cpuinfo; then
+    suffix=avx512
+elif grep -q "avx2" /proc/cpuinfo; then
+    suffix=avx2
+fi
+
+prefix=intgemm_16bit_preprocessed
+prefix_ref=intgemm_16bit
+
+
+# Remove previous outputs
+rm -f $prefix.out $prefix.$suffix.bin
+
+# Pack the model
+$MRT_MARIAN/marian-conv -f $MRT_MODELS/student-eten/model.npz -t $prefix.$suffix.bin --gemm-type intgemm16
+test -s $prefix.$suffix.bin
+
+# Run test
+$MRT_MARIAN/marian-decoder \
+    -m $prefix.$suffix.bin -v $MRT_MODELS/student-eten/{vocab.spm,vocab.spm} \
+    -i newstest2018.src -o $prefix.out \
+    -b 1 --mini-batch 32 --maxi-batch 100 --maxi-batch-sort src -w 128 \
+    --shortlist $MRT_MODELS/student-eten/lex.s2t 50 50 --cpu-threads 1 --int16 \
+    --quiet-translation
+
+# Print current and expected BLEU for debugging
+python3 $MRT_TOOLS/sacrebleu/sacrebleu.py newstest2018.ref < $prefix.out | tee $prefix.out.bleu
+cat $prefix_ref.$suffix.expected.bleu
+
+# Compare with the expected output
+$MRT_TOOLS/diff.sh $prefix.out $prefix_ref.$suffix.expected > $prefix.diff
+
+
+# Exit with success code
+exit 0
diff --git a/tests/decoder/intgemm/test_intgemm_8bit.sh b/tests/decoder/intgemm/test_intgemm_8bit.sh
new file mode 100644
index 0000000..2a17b28
--- /dev/null
+++ b/tests/decoder/intgemm/test_intgemm_8bit.sh
@@ -0,0 +1,53 @@
+#!/bin/bash
+
+#####################################################################
+# SUMMARY: Decode intgemm 8bit with on-the-fly conversion
+# TAGS: cpu student shortlist intgemm
+#####################################################################
+
+# Exit on error
+set -e
+
+# Skip if requirements are not met
+if [ ! $MRT_MARIAN_USE_MKL ]; then
+    echo "Marian is not compiled with CPU" 1>&2
+    exit 100
+elif ! grep -q "avx" /proc/cpuinfo; then
+    echo "Your CPU does not support AVX, which is required" 1>&2
+    exit 100
+fi
+
+# Outputs differ on CPUs supporting AVX AVX2 or AVX512
+suffix=avx
+if grep -q "avx512_vnni" /proc/cpuinfo; then
+    suffix=avx512_vnni
+elif grep -q "avx512" /proc/cpuinfo; then
+    suffix=avx512
+elif grep -q "avx2" /proc/cpuinfo; then
+    suffix=avx2
+fi
+
+prefix=intgemm_8bit
+
+
+# Remove previous outputs
+rm -f $prefix.out
+
+# Run test
+$MRT_MARIAN/marian-decoder \
+    -m $MRT_MODELS/student-eten/model.npz -v $MRT_MODELS/student-eten/{vocab.spm,vocab.spm} \
+    -i newstest2018.src -o $prefix.out \
+    -b 1 --mini-batch 32 --maxi-batch 100 --maxi-batch-sort src -w 128 \
+    --shortlist $MRT_MODELS/student-eten/lex.s2t 50 50 --cpu-threads 1 --int8 \
+    --quiet-translation
+
+# Print current and expected BLEU for debugging
+python3 $MRT_TOOLS/sacrebleu/sacrebleu.py newstest2018.ref < $prefix.out | tee $prefix.out.bleu
+cat $prefix.$suffix.expected.bleu
+
+# Compare with the expected output
+$MRT_TOOLS/diff.sh $prefix.out $prefix.$suffix.expected > $prefix.diff
+
+
+# Exit with success code
+exit 0
diff --git a/tests/decoder/intgemm/test_intgemm_8bit_preprocessed.sh b/tests/decoder/intgemm/test_intgemm_8bit_preprocessed.sh
new file mode 100644
index 0000000..bfeba0a
--- /dev/null
+++ b/tests/decoder/intgemm/test_intgemm_8bit_preprocessed.sh
@@ -0,0 +1,58 @@
+#!/bin/bash
+
+#####################################################################
+# SUMMARY: Decode intgemm 8bit with a binary model
+# TAGS: cpu student shortlist intgemm
+#####################################################################
+
+# Exit on error
+set -e
+
+# Skip if requirements are not met
+if [ ! $MRT_MARIAN_USE_MKL ]; then
+    echo "Marian is not compiled with CPU" 1>&2
+    exit 100
+elif ! grep -q "avx" /proc/cpuinfo; then
+    echo "Your CPU does not support AVX, which is required" 1>&2
+    exit 100
+fi
+
+# Outputs differ on CPUs supporting AVX AVX2 or AVX512
+suffix=avx
+if grep -q "avx512_vnni" /proc/cpuinfo; then
+    suffix=avx512_vnni
+elif grep -q "avx512" /proc/cpuinfo; then
+    suffix=avx512
+elif grep -q "avx2" /proc/cpuinfo; then
+    suffix=avx2
+fi
+
+prefix=intgemm_8bit_preprocessed
+prefix_ref=intgemm_8bit
+
+
+# Remove previous outputs
+rm -f $prefix.out $prefix.$suffix.bin
+
+# Pack the model
+$MRT_MARIAN/marian-conv -f $MRT_MODELS/student-eten/model.npz -t $prefix.$suffix.bin --gemm-type intgemm8
+test -s $prefix.$suffix.bin
+
+# Run test
+$MRT_MARIAN/marian-decoder \
+    -m $prefix.$suffix.bin -v $MRT_MODELS/student-eten/{vocab.spm,vocab.spm} \
+    -i newstest2018.src -o $prefix.out \
+    -b 1 --mini-batch 32 --maxi-batch 100 --maxi-batch-sort src -w 128 \
+    --shortlist $MRT_MODELS/student-eten/lex.s2t 50 50 --cpu-threads 1 --int8 \
+    --quiet-translation
+
+# Print current and expected BLEU for debugging
+python3 $MRT_TOOLS/sacrebleu/sacrebleu.py newstest2018.ref < $prefix.out | tee $prefix.out.bleu
+cat $prefix_ref.$suffix.expected.bleu
+
+# Compare with the expected output
+$MRT_TOOLS/diff.sh $prefix.out $prefix_ref.$suffix.expected > $prefix.diff
+
+
+# Exit with success code
+exit 0
diff --git a/tests/decoder/intgemm/test_intgemm_8bit_shifted.sh b/tests/decoder/intgemm/test_intgemm_8bit_shifted.sh
new file mode 100644
index 0000000..1782f35
--- /dev/null
+++ b/tests/decoder/intgemm/test_intgemm_8bit_shifted.sh
@@ -0,0 +1,57 @@
+#!/bin/bash
+
+#####################################################################
+# SUMMARY: Decode intgemm 8bit shifted with a binary model
+# TAGS: cpu student shortlist intgemm
+#####################################################################
+
+# Exit on error
+set -e
+
+# Skip if requirements are not met
+if [ ! $MRT_MARIAN_USE_MKL ]; then
+    echo "Marian is not compiled with CPU" 1>&2
+    exit 100
+elif ! grep -q "avx" /proc/cpuinfo; then
+    echo "Your CPU does not support AVX, which is required" 1>&2
+    exit 100
+fi
+
+# Outputs differ on CPUs supporting AVX AVX2 or AVX512
+suffix=avx
+if grep -q "avx512_vnni" /proc/cpuinfo; then
+    suffix=avx512_vnni
+elif grep -q "avx512" /proc/cpuinfo; then
+    suffix=avx512
+elif grep -q "avx2" /proc/cpuinfo; then
+    suffix=avx2
+fi
+
+prefix=intgemm_8bit_shifted
+
+
+# Remove previous outputs
+rm -f $prefix.out $prefix.$suffix.bin
+
+# Pack the model
+$MRT_MARIAN/marian-conv -f $MRT_MODELS/student-eten/model.npz -t $prefix.$suffix.bin --gemm-type intgemm8
+test -s $prefix.$suffix.bin
+
+# Run test
+$MRT_MARIAN/marian-decoder \
+    -m $prefix.$suffix.bin -v $MRT_MODELS/student-eten/{vocab.spm,vocab.spm} \
+    -i newstest2018.src -o $prefix.out \
+    -b 1 --mini-batch 32 --maxi-batch 100 --maxi-batch-sort src -w 128 \
+    --shortlist $MRT_MODELS/student-eten/lex.s2t 50 50 --cpu-threads 1 --int8shift \
+    --quiet-translation
+
+# Print current and expected BLEU for debugging
+python3 $MRT_TOOLS/sacrebleu/sacrebleu.py newstest2018.ref < $prefix.out | tee $prefix.out.bleu
+cat $prefix.$suffix.expected.bleu
+
+# Compare with the expected output
+$MRT_TOOLS/diff.sh $prefix.out $prefix.$suffix.expected > $prefix.diff
+
+
+# Exit with success code
+exit 0