Portable Executable Parser

pe is a go package for parsing the portable executable file format. This package was designed with malware analysis in mind, and being resistent to PE malformations.

Table of content

• Portable Executable Parser
  • Table of content
  • Features
  • Installing
  • Using the library
    • PE Header
    • Rich Header
    • Iterating over sections
  • Roadmap
  • Fuzz Testing
  • Projects Using This Library
  • References

Features

• Works with PE32/PE32+ file format.
• Supports Intel x86/AMD64/ARM7ARM7 Thumb/ARM8-64/IA64/CHPE architectures.
• MS DOS header.
• Rich Header (calculate checksum and hash).
• NT Header (file header + optional header).
• COFF symbol table and string table.
• Sections headers + entropy calculation.
• Data directories
  • Import Table + ImpHash calculation.
  • Export Table
  • Resource Table
  • Exceptions Table
  • Security Table + Authentihash calculation.
  • Relocations Table
  • Debug Table (CODEVIEW, POGO, VC FEATURE, REPRO, FPO, EXDLL CHARACTERISTICS debug types).
  • TLS Table
  • Load Config Directory (SEH, GFID, GIAT, Guard LongJumps, CHPE, Dynamic Value Reloc Table, Enclave Configuration, Volatile Metadata tables).
  • Bound Import Table
  • Delay Import Table
  • COM Table (CLR Metadata Header, Metadata Table Streams)
• Report several anomalies

Installing

Using this go package is easy. First, use go get to install the latest version of the library. This command will install the pedumper executable along with the library and its dependencies:

go get -u github.com/saferwall/pe

Next, include pe package in your application:

import "github.com/saferwall/pe"

Using the library

package main
import (
    peparser "github.com/saferwall/pe"
)
func main() {
    filename := "C:\\Binaries\\notepad.exe"
    pe, err := peparser.New(filename, &peparser.Options{})
    if err != nil {
        log.Fatalf("Error while opening file: %s, reason: %v", filename, err)
    }
    err = pe.Parse()
    if err != nil {
        log.Fatalf("Error while parsing file: %s, reason: %v", filename, err)
    }
}

Start by instantiating a pe object by called the New() method, which takes the file path to the file to be parsed and some optional options.

Afterwards, a call to the Parse() method will give you access to all the different part of the PE format, directly accessible to be used. Here is the definition of the struct:

type File struct {
    DOSHeader    ImageDOSHeader              `json:"dos_header,omitempty"`
    RichHeader   RichHeader                  `json:"rich_header,omitempty"`
    NtHeader     ImageNtHeader               `json:"nt_header,omitempty"`
    COFF         COFF                        `json:"coff,omitempty"`
    Sections     []Section                   `json:"sections,omitempty"`
    Imports      []Import                    `json:"imports,omitempty"`
    Export       Export                      `json:"export,omitempty"`
    Debugs       []DebugEntry                `json:"debugs,omitempty"`
    Relocations  []Relocation                `json:"relocations,omitempty"`
    Resources    ResourceDirectory           `json:"resources,omitempty"`
    TLS          TLSDirectory                `json:"tls,omitempty"`
    LoadConfig   LoadConfig                  `json:"load_config,omitempty"`
    Exceptions   []Exception                 `json:"exceptions,omitempty"`
    Certificates CertificateSection          `json:"certificates,omitempty"`
    DelayImports []DelayImport               `json:"delay_imports,omitempty"`
    BoundImports []BoundImportDescriptorData `json:"bound_imports,omitempty"`
    GlobalPtr    uint32                      `json:"global_ptr,omitempty"`
    CLR          CLRData                     `json:"clr,omitempty"`
    IAT          []IATEntry                  `json:"iat,omitempty"`
    Anomalies    []string                    `json:"anomalies,omitempty"`
    Header       []byte
    data         mmap.MMap
    FileInfo
    size          uint32
    OverlayOffset int64
    f             *os.File
    opts          *Options
    logger        *log.Helper
}

PE Header

As mentioned before, all members of the struct are directly (no getters) accessible, additionally, the fields types has been preserved as the spec defines them, that means if you need to show the prettified version of an int type, you have to call the corresponding helper function.

fmt.Printf("Magic is: 0x%x\n", pe.DOSHeader.Magic)
fmt.Printf("Signature is: 0x%x\n", pe.NtHeader.Signature)
fmt.Printf("Machine is: 0x%x, Meaning: %s\n", pe.NtHeader.FileHeader.Machine, pe.NtHeader.FileHeader.Machine.String())

Output:

Magic is: 0x5a4d
Signature is: 0x4550
Machine is: 0x8664, Meaning: x64

Rich Header

Example:

richHeader, _ := json.Marshal(pe.RichHeader)
fmt.Print(prettyPrint(richHeader))

Output:

{
    "XorKey": 2796214951,
    "CompIDs": [
        {
            "MinorCV": 27412,
            "ProdID": 257,
            "Count": 4,
            "Unmasked": 16870164
        },
        {
            "MinorCV": 30729,
            "ProdID": 147,
            "Count": 193,
            "Unmasked": 9664521
        },
        {
            "MinorCV": 0,
            "ProdID": 1,
            "Count": 1325,
            "Unmasked": 65536
        },
        {
            "MinorCV": 27412,
            "ProdID": 260,
            "Count": 9,
            "Unmasked": 17066772
        },
        {
            "MinorCV": 27412,
            "ProdID": 259,
            "Count": 3,
            "Unmasked": 17001236
        },
        {
            "MinorCV": 27412,
            "ProdID": 256,
            "Count": 1,
            "Unmasked": 16804628
        },
        {
            "MinorCV": 27412,
            "ProdID": 269,
            "Count": 209,
            "Unmasked": 17656596
        },
        {
            "MinorCV": 27412,
            "ProdID": 255,
            "Count": 1,
            "Unmasked": 16739092
        },
        {
            "MinorCV": 27412,
            "ProdID": 258,
            "Count": 1,
            "Unmasked": 16935700
        }
    ],
    "DansOffset": 128,
    "Raw": "47vE9afaqqan2qqmp9qqprOxq6ej2qqmrqI5pmbaqqan2qumit+qprOxrqeu2qqms7Gpp6TaqqazsaqnptqqprOxp6d22qqms7FVpqbaqqazsainptqqplJpY2in2qqm"
}

Iterating over sections

for _, sec := range pe.Sections {
    fmt.Printf("Section Name : %s\n", sec.NameString())
    fmt.Printf("Section VirtualSize : %x\n", sec.Header.VirtualSize)
    fmt.Printf("Section Flags : %x, Meaning: %v\n\n",
        sec.Header.Characteristics, sec.PrettySectionFlags())
}

Output:

Section Name : .text
Section VirtualSize : 2ea58
Section Flags : 60500060, Meaning: [Align8Bytes Readable Align16Bytes Executable Contains Code Initialized Data Align1Bytes]
Section Name : .data
Section VirtualSize : 58
Section Flags : c0500040, Meaning: [Readable Initialized Data Writable Align1Bytes Align16Bytes Align8Bytes]
Section Name : .rdata
Section VirtualSize : 18d0
Section Flags : 40600040, Meaning: [Align2Bytes Align8Bytes Readable Initialized Data Align32Bytes]
...

Roadmap

• imports MS-styled names demangling
• PE: VB5 and VB6 typical structures: project info, DLLCall-imports, referenced modules, object table

Fuzz Testing

To validate the parser we use the go-fuzz and a corpus of known malformed and tricky PE files from corkami.

Projects Using This Library

Fibratus A modern tool for Windows kernel exploration and tracing with a focus on security.

References

• Peering Inside the PE: A Tour of the Win32 Portable Executable File Format by Matt Pietrek
• An In-Depth Look into the Win32 Portable Executable File Format - Part 1 by Matt Pietrek
• An In-Depth Look into the Win32 Portable Executable File Format - Part 2 by Matt Pietrek
• Portable Executable File Format
• PE Format MSDN spec
• DotNET format
• BlackHat 2011 - CONSTANT INSECURITY: (PECOFF) Portable Executable FIle Format