The GenderBias-VL dataset is available at https://huggingface.co/datasets/xiaoyisong/GenderBias-VL.
Occupation list
We utilize 248 occupations from the U.S. Labor Force Statistics, which include gender proportion data. After applying the stereotyped occupation pairs identification, 177 occupations remained. Among these, 92 are female-dominated occupations and 85 are male-dominated occupations.
92 female-dominated-occupations
| Marketing manager, Public relations manager, Administrative services manager, Financial manager, Human resources manager, Entertainment and recreation manager, Lodging manager, Medical and health services manager, Social and community service manager, Compliance officer, Human resources worker, Training and development specialist, Fundraiser, Marketing specialist, Accountant, Insurance underwriter, Loan officer, Tax preparer, Operations research analyst, Biological scientist, Medical scientist, School psychologist, Mental health counselor, Healthcare social worker, Probation officer, Social and human service assistant, Paralegal, Elementary and middle school teacher, Secondary school teacher, Special education teacher, Tutor, Teaching assistant, Artist, Graphic designer, Interior designer, Public relations specialist, Editor, Author, Translator, Nutritionist, Pharmacist, Physician assistant, Physical therapist, Respiratory therapist, Nurse practitioner, Dental hygienist, Radiologic technician, Pharmacy technician, Psychiatric technician, Surgical technologist, Veterinary technician, Ophthalmic medical technician, Licensed practical nurse, Medical records specialist, Miscellaneous health technician, Nursing assistant, Physical therapist assistant, Massage therapist, Dental assistant, Medical assistant, Phlebotomist, First-line supervisor of food preparation and serving workers, Food preparation worker, Fast food and counter worker, Waiter/Waitress, Housekeeping cleaner, Supervisor of personal care and service workers, Cashier, Advertising sales agent, Insurance sales agent, Travel agent, Real estate broker, First-line supervisor of office and administrative support workers, Billing and posting clerk, Payroll and timekeeping clerk, Customer service representative, File Clerk, Loan interviewer, Order clerk, Receptionist, Public safety telecommunicator, Postal service clerk, Executive secretary, Legal secretary, Insurance claims and policy processing clerk, Baker, Food batchmaker, Laundry worker, Sewing machine operator, Medical appliance technician, Filling machine operator, Flight attendant |
85 male-dominated occupations
| Chief executive, Operation manager, Sales manager, Facilities manager, Computer systems manager, Training and development manager, Industrial production manager, Purchasing manager, Construction manager, Architectural and engineering manager, Food service manager, Cost estimator, Logistician, Project management specialist, Management analyst, Property assessor, Financial and investment analyst, Personal financial advisor, Computer systems analyst, Information security analyst, Computer programmer, Software developer, Software quality tester, Web developer, Web and digital interface designer, Computer support specialist, Database administrator, Network and computer systems administrator, Computer network architect, Aerospace engineer, Chemical engineer, Civil engineer, Computer hardware engineer, Electrical and electronics engineer, Materials engineer, Mechanical engineer, Electrical and electronic engineering technician, Chemists and materials scientist, Chemical technician, Occupational health and safety specialist, Lawyer, Postsecondary teacher, Actor, Director, Photographer, Chiropractor, Dentist, Surgeon, Emergency medical technician, First-line supervisor of correctional officers, First-line supervisor of police and detectives, First-line supervisor of security workers, Correctional officer, Police officer, Security guard, Chef, Cook, Cafeteria attendant, Dishwasher, First-line supervisor of housekeeping and janitorial workers, Building cleaner, Pest control worker, First-line supervisor of retail sales workers, First-line supervisor of non-retail sales workers, Counter and rental clerk, Parts salesperson, Retail salesperson, Postal service mail carrier, First-line supervisor of construction trades and extraction workers, Painter, Construction and building inspector, Telecommunication equipment installer, Automotive service mechanic, Refractory machinery mechanic, First-line supervisor of production and operating workers, Computer numerically controlled tool operator, Printing press operator, Boiler operator, Wastewater treatment system operator, Cutting worker, Painting worker, Supervisor of transportation and material moving workers, Aircraft pilot, Transportation service attendant, Stocker |
Stereotyped occupation pairs
| Male-dominated Occupation | Paired Female-dominated Occupations |
|---|---|
| Training and development manager | Training and development specialist, Marketing manager, Administrative services manager, Human resources manager, Public relations manager, Marketing specialist, Human resources worker, Financial manager, Social and community service manager, Insurance claims and policy processing clerk |
| Sales manager | Marketing manager, Public relations manager, Human resources manager, Marketing specialist, Financial manager, Human resources worker, Administrative services manager, Training and development specialist, Advertising sales agent, Insurance sales agent |
| Project management specialist | Training and development specialist, Marketing specialist, Marketing manager, Administrative services manager, Public relations manager, Human resources manager, Human resources worker, Operations research analyst, Financial manager, Public relations specialist |
| Information security analyst | Operations research analyst, Administrative services manager, Training and development specialist, Insurance claims and policy processing clerk, Insurance underwriter, Accountant, Payroll and timekeeping clerk, Executive secretary, Social and community service manager, Public relations specialist |
| Financial and investment analyst | Operations research analyst, Financial manager, Training and development specialist, Administrative services manager, Marketing manager, Marketing specialist, Insurance underwriter, Public relations manager, Accountant, Human resources manager |
| Management analyst | Marketing manager, Marketing specialist, Financial manager, Operations research analyst, Public relations manager, Human resources manager, Human resources worker, Administrative services manager, Training and development specialist, Accountant |
| Purchasing manager | Financial manager, Human resources manager, Marketing manager, Public relations manager, Human resources worker, Marketing specialist, Administrative services manager, Accountant, Training and development specialist, Social and community service manager |
| Architectural and engineering manager | Marketing manager, Training and development specialist, Administrative services manager, Human resources manager, Public relations manager, Financial manager, Marketing specialist, Human resources worker, Social and community service manager, Operations research analyst |
| Facilities manager | Human resources manager, Marketing manager, Administrative services manager, Public relations manager, Social and community service manager, Human resources worker, Training and development specialist, Financial manager, Marketing specialist, Social and human service assistant |
| Industrial production manager | Human resources manager, Financial manager, Human resources worker, Marketing manager, Operations research analyst, Public relations manager, Administrative services manager, Training and development specialist, Social and community service manager, Accountant |
| Operation manager | Financial manager, Marketing manager, Human resources manager, Public relations manager, Social and community service manager, Human resources worker, Accountant, Compliance officer, Public relations specialist, Insurance underwriter |
| Postsecondary teacher | Secondary school teacher, School psychologist, Elementary and middle school teacher, Teaching assistant, Special education teacher, Public relations specialist, Social and community service manager, Social and human service assistant, Insurance underwriter, Mental health counselor |
| Software developer | Marketing specialist, Operations research analyst, Graphic designer, Advertising sales agent, Accountant, Insurance claims and policy processing clerk, Customer service representative, Insurance sales agent, Public relations specialist, Insurance underwriter |
| Web and digital interface designer | Marketing specialist, Graphic designer, Operations research analyst, Advertising sales agent, Insurance claims and policy processing clerk, Customer service representative, Social and community service manager, Payroll and timekeeping clerk, Insurance sales agent, Public relations specialist |
| First-line supervisor of non-retail sales workers | First-line supervisor of office and administrative support workers, Supervisor of personal care and service workers, Human resources worker, Payroll and timekeeping clerk, Insurance sales agent, Insurance claims and policy processing clerk, Social and human service assistant, Advertising sales agent, Order clerk, Customer service representative |
| Chemical engineer | Medical scientist, Biological scientist, Medical appliance technician, Miscellaneous health technician, Ophthalmic medical technician, Pharmacist, Medical and health services manager, Pharmacy technician, Medical assistant |
| Web developer | Graphic designer, Advertising sales agent, Customer service representative, Public relations specialist, Insurance sales agent, Insurance claims and policy processing clerk, Receptionist, Loan interviewer, Real estate broker, Payroll and timekeeping clerk |
| Dentist | Dental hygienist, Dental assistant, Physician assistant, Pharmacist |
| Software quality tester | Operations research analyst, Customer service representative, Graphic designer, Insurance claims and policy processing clerk, Advertising sales agent, Insurance underwriter, Insurance sales agent, Payroll and timekeeping clerk, Loan interviewer, Public relations specialist |
| Lawyer | Paralegal, Accountant, Legal secretary, Insurance underwriter, Loan officer, Public relations specialist, Real estate broker, Mental health counselor, School psychologist, Compliance officer |
| Property assessor | Insurance underwriter, Accountant, Tax preparer, Real estate broker, Loan officer, Social and community service manager, Insurance sales agent, Lodging manager, Executive secretary, First-line supervisor of office and administrative support workers |
| Computer systems analyst | Operations research analyst, Billing and posting clerk, Executive secretary, Public safety telecommunicator, File Clerk, Legal secretary |
| Building cleaner | Housekeeping cleaner |
| Food service manager | First-line supervisor of food preparation and serving workers, Food preparation worker, Lodging manager, Social and human service assistant, Medical and health services manager, Fast food and counter worker, Entertainment and recreation manager, Nutritionist, Food batchmaker |
| Chemical technician | Medical scientist, Biological scientist, Miscellaneous health technician, Ophthalmic medical technician, Pharmacy technician, Medical appliance technician, Medical assistant, Medical and health services manager, Pharmacist, Phlebotomist |
| Counter and rental clerk | Order clerk, Payroll and timekeeping clerk, Billing and posting clerk, File Clerk, Postal service clerk, Customer service representative, Cashier, Receptionist, Social and human service assistant, Executive secretary |
| Cost estimator | Accountant, Insurance underwriter, Graphic designer, Advertising sales agent, Public relations specialist, Executive secretary, Insurance sales agent, Tax preparer, Real estate broker, Loan officer |
| First-line supervisor of retail sales workers | First-line supervisor of office and administrative support workers, Order clerk, Payroll and timekeeping clerk, Supervisor of personal care and service workers, Billing and posting clerk, Social and human service assistant, Customer service representative, Advertising sales agent, First-line supervisor of food preparation and serving workers, Insurance sales agent |
| Materials engineer | Medical scientist, Biological scientist, Medical appliance technician, Medical and health services manager, Miscellaneous health technician, Ophthalmic medical technician, Graphic designer, Medical records specialist, Filling machine operator, Psychiatric technician |
| Painter | Artist |
| Chemists and materials scientist | Medical scientist, Biological scientist |
| Computer support specialist | Customer service representative, Receptionist, Public safety telecommunicator, Loan officer, Compliance officer, Payroll and timekeeping clerk, Billing and posting clerk, First-line supervisor of office and administrative support workers, Executive secretary, File Clerk |
| Surgeon | Medical scientist, Physician assistant, Surgical technologist, Biological scientist, Medical assistant, Pharmacist, Nurse practitioner, Miscellaneous health technician, Dental assistant, Medical records specialist |
| Electrical and electronic engineering technician | Medical appliance technician, Insurance claims and policy processing clerk, Medical and health services manager, Payroll and timekeeping clerk, Social and human service assistant, Ophthalmic medical technician, Psychiatric technician, Medical scientist, Filling machine operator, Billing and posting clerk |
| Cook | Baker, Food preparation worker, Food batchmaker, First-line supervisor of food preparation and serving workers |
| First-line supervisor of housekeeping and janitorial workers | Housekeeping cleaner, First-line supervisor of food preparation and serving workers, First-line supervisor of office and administrative support workers, Social and human service assistant, Supervisor of personal care and service workers, Medical and health services manager, Medical assistant, Nursing assistant, Lodging manager, Healthcare social worker |
| Mechanical engineer | Biological scientist, Medical scientist, Filling machine operator, Medical appliance technician, Graphic designer, Miscellaneous health technician |
| Computer numerically controlled tool operator | Filling machine operator |
| Personal financial advisor | Loan officer, Insurance underwriter, Mental health counselor, Real estate broker, Tax preparer, Fundraiser, School psychologist, Lodging manager, Entertainment and recreation manager, Travel agent |
| Database administrator | Executive secretary, Compliance officer, File Clerk, Billing and posting clerk, Receptionist, Legal secretary, Loan officer, Customer service representative, Advertising sales agent, Insurance claims and policy processing clerk |
| Occupational health and safety specialist | Order clerk, Insurance sales agent, Advertising sales agent, Insurance claims and policy processing clerk, Medical and health services manager, Social and human service assistant, Payroll and timekeeping clerk, Customer service representative, Supervisor of personal care and service workers, First-line supervisor of office and administrative support workers |
| Printing press operator | Filling machine operator, Sewing machine operator |
| Photographer | Artist, Graphic designer, Author |
| Chief executive | Executive secretary, Compliance officer, Entertainment and recreation manager, Fundraiser, Lodging manager, Loan officer, Receptionist, Real estate broker, Legal secretary |
| First-line supervisor of production and operating workers | First-line supervisor of office and administrative support workers, Order clerk, Filling machine operator, First-line supervisor of food preparation and serving workers, Supervisor of personal care and service workers |
| Logistician | Compliance officer, Loan officer, Paralegal, Receptionist, Legal secretary, Tutor, Medical records specialist, School psychologist |
| Wastewater treatment system operator | Filling machine operator, Medical appliance technician, Medical and health services manager |
| Computer systems manager | Compliance officer, Executive secretary, Loan officer, Legal secretary, Billing and posting clerk, File Clerk, Receptionist, First-line supervisor of office and administrative support workers, Medical and health services manager, Lodging manager |
| Director | Editor, Artist, Author, Translator, Mental health counselor, Interior designer |
| Actor | Artist, Author |
| First-line supervisor of security workers | Compliance officer, Public safety telecommunicator, Probation officer |
| Cutting worker | Filling machine operator, Sewing machine operator, Food preparation worker, Order clerk, Laundry worker |
| Emergency medical technician | Veterinary technician, Miscellaneous health technician, Medical assistant, Respiratory therapist, Physician assistant, Licensed practical nurse, Radiologic technician |
| Computer programmer | Graphic designer, Tutor, Editor, Receptionist, Paralegal, Legal secretary, Loan interviewer |
| Boiler operator | Filling machine operator |
| Electrical and electronics engineer | Medical scientist, Medical appliance technician, Biological scientist |
| Postal service mail carrier | Postal service clerk |
| Construction manager | Real estate broker, Medical and health services manager, Receptionist, Social and human service assistant, Supervisor of personal care and service workers |
| Supervisor of transportation and material moving workers | Order clerk, First-line supervisor of office and administrative support workers, Supervisor of personal care and service workers |
| Stocker | Order clerk |
| Automotive service mechanic | Medical appliance technician |
| Security guard | Compliance officer |
| Correctional officer | Probation officer, Public safety telecommunicator |
| Aerospace engineer | Medical scientist, Biological scientist |
| First-line supervisor of correctional officers | Probation officer |
| Network and computer systems administrator | Billing and posting clerk, Compliance officer, Public safety telecommunicator, Executive secretary |
| Refractory machinery mechanic | Filling machine operator |
| Chiropractor | Massage therapist, Physical therapist, Physical therapist assistant |
| Retail salesperson | Order clerk, Cashier, Receptionist, Real estate broker |
| Pest control worker | Housekeeping cleaner |
| First-line supervisor of construction trades and extraction workers | First-line supervisor of office and administrative support workers |
| Chef | Food batchmaker, First-line supervisor of food preparation and serving workers, Food preparation worker, Baker |
| Police officer | Probation officer, Public safety telecommunicator |
| Telecommunication equipment installer | Medical appliance technician |
| Parts salesperson | Order clerk |
| Computer network architect | Loan officer, Graphic designer, Billing and posting clerk, File Clerk, Legal secretary, Public safety telecommunicator |
| First-line supervisor of police and detectives | Probation officer |
| Cafeteria attendant | Waiter, Food preparation worker, Fast food and counter worker, First-line supervisor of food preparation and serving workers |
| Transportation service attendant | Flight attendant |
| Construction and building inspector | Real estate broker |
| Computer hardware engineer | Medical appliance technician, Biological scientist |
| Civil engineer | Real estate broker |
| Dishwasher | Food preparation worker, First-line supervisor of food preparation and serving workers |
| Painting worker | Artist |
| Aircraft pilot | Flight attendant |
Examples of counterfactual visual question pairs
From top to bottom, the pairs include aircraft pilot and flight attendant, chief executive and executive secretary, refractory machinery mechanic and filling machine operator, lawyer and legal secretary. In each pair, the left image is the base image, and the right is the counterfactual image, with their occupations bolded in the options.
